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ABSTRACT 
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Preface 

What the manual is : «. 

Intrinsic analysis of curriculum products, instructional practices 

or management systems is taught by this manual* Intrinsic analysis ipeafts 

analysis of the instruction or process through examination of trie mater- 

ials, or artifacts, including teacher and student materials, developer's 

rationale, record forms, scope and' sequence charts* tests, media package 

and any other relevant concrete components of the product or system. 

« 

The manual includes instruction, exercises for practice of key 
skills; analysis instruments for both products and processes (long and 
short 1 forms); an instrument for description of the instructional model; 
a listing of step-by-step procedures; and an annotated bibliography* 
Advantages of the manual : « s. 

The intrinsic analysis system provides more information, more re- 
liable information, and more relevant information to schools using it 
for analyzing their present program or proposed ^adoptions that usually 
is provided by publishers, product catalogues or nationally distributed 
analyses because it includes the following 'unique features: 

1. It is designed to be site specific* Questions in the analysis 
instruments are addressed to needs of the school which uses the manual. 
This produces an analysis tailored to thfcse needs. 

2. It is a research-based analysis model with the research on 

v 

each elemerit cited in an annotated bibliography* 




3. It translates the research supported classroom concepts ol 
"direct instruction" and '/engaged time" into their equivalents in in^ 
structlonfiCL materials and systems terms* 

4. It leads to r identif ication of the jpritical elements of the 
curriculum or system model by the analysts who, in most cases include 
thbs^ who will implement the model. This should facilitate appropriate 
adaptation to site without undermining the critical elements which make 
it work. 

* 5. It provides a systematic logical procedure for quality rating 
and comparing curricula while allowing, and facilitating a group process I 
of decision-making that is based on commonly defined elements. This makes 
it ideal for the PSIP process for both program analysis and selection. 
Limitations pf the, manual : 

1. This manual does not teach all the skills required for perform- 
ing ait intrinsic analysis of a curriculum product or process. Some n^pes- 
sary skills are prerequisite general teacher competencies. Others are 
skills basred on the analyst's* knowledge and understanding about character- 
istics of his or her colleagues and the students they thiach. 

f 2. While t;he .constructs and questions which are the substance of 
the instruments and which direct the analysis process are research based, 

there are only a few references in the manual. This is purposeful to 
* 

avoid cluttering up the description of the process with scholarly refer- 

N 

I 

ences. Each concept within a construct provides a slightly different 
'perspective on the construct and reader concentration is needed to assim- 
ilate the coniepts/ • < ^ 

' -5 •- \ ■ ' 
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* In place of such references, there is an annotated bibliography 
keye/ to the constructs and the skills taught in the. manual. 

3. The identification of the critical elements of a curriculum or # 
a process model is more of an art than a science. Effectiveness of each 
product or process may hinge on different elements. Some curriculum 

models are heavily dependent on their subject matter specific teaching 

• * 

methods or 'strategies. Some models are effective largely because of 
their structure or management system. Some effective curricula are 
highly complex and have many critical elements that ap^ear~^o\be inter- 
dependent • 

Under these circumstances, a procedure is required for recording 
all cues to the critical elements of the model as the analysis proceeds. 
Then, as more and more Is learned about the product or process, these 
notes may be revised and focused until at the conclusion of the analysis, 
the analyst can use the mddel instrument to tease out the model. The 
whole analysis process immerses the analyst in the curriculum or process 

components and the final step simply focuses and refines the accumulated 

* • 
perceptions. . v 

Therefore as the analyst proceeds through this manual, he or she 
sjiould note cues* to the elements that appear to be emphasized a? important 
to effectiveness and any evidence in support of the elements should f>e ) ' 
identified and noted, also. These are essential^procedures not system- 
atically alluded to in the instruments or the text. 



ERIC 



6 



Table of Contents . * •' 

- Page 



Preface i 

Introduction . \ .* * . .4. . ^ 1 

Constructs', Artifacts, Elements and Criteria 5 

Analysis of Student Materials, Inservice Materials p 

Parent Materials • . . 11 

Preparation aAd Previewing 11 

The Construct, Opportunity ; . . , /. . . 14 

The Construct, Motivators . . ^ ^ . 22 

The Construct, 'Structure 2^ 

The Construct, Instructional Events 44 

Analysis of Management System, Practices of Processed ..... 54 

' ire 

Preparation and Previewing ' . . 55 

The Construct, Opportunity • 56 

The Construct, Motivators . . . ._ t .......... *58 

The Construct, Structure 61 

The Construct, Instructional Events 63 

Analysis of the Curriculum Model or the Instructional Management Process . 66 

* Exercises 75 

Answer- Key . If .84 

* . t 

Instruments x 

Part'l (SIP Form) ...... 88 

Part 2 (MPP Foipn) 94 

' Part 3 (Curriculum Model, Management Process) 97 

intrinsic Analysis Instrument Long Form . . . *. . . . 98 

Steps in Performing an Intrinsic Analysis . .110 

Selection Chart Product . . . . • ' 118 

Selection Chart Processes 

Annotated Bibliography \ , 120 



1 • 



1 • • « 

Intrinsic Analysis Training- Manual. 

1 * \ . 

\ v Introduction 

This manual is a description and. instruction in the use of the 
process '^of intrinsic analysis of curriculum products and of management 
systems practices or processes. This type of apalysis has been used 
to provide Local Action Teams of - the Pennsylvania School Improvement 



/ 



Project with a mor£ in-depth analysis of theiif present program than 

\ * 

H usually is undertaken in the program analysis phase of the PSIP process. 
^ tt has been used, at the requeit of the LAT, for analyses of all or any 
designated part of the school f s present program or for analyses of 
products or processes being considered for adoption. 

The manual is built around an intrinsic analysis instrument which 
has three parts and two forms. One part. is for analysis of studeht and 
^ teachej materials, inservice materials or parent material^ (Slfl form). 
These could range from single modules for a one-day .wQrkshop, through 

■ _/ ■ . r * • ■ 

course textbooks with teachers editions, tcF extensive multi-level, multi- 

i 

media total ins true tibna^ programs. 

The second part is for management- systems practices or prodesses ' 
\ 

(MPP form). It could be used to analyz^ a b.ehavior modification project 
in a classroom, a self-management system, a process for individualizing 
any presently 'used basal text, or ajiy other system which is not instruc- 
tional content. based . 

0 

4 The third part of the instrument consists of a series of questions 

» 

which guide the analyst in uncovering the instructional model of any 

«» 

* 'product or process being analyzed and suggest some considerations related * » 
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to the model and its significance for effective implementation and 

♦ 

adaptation of any Innovation. - * 

Finally, in addition to these instruments, there are two selection 

charts vhich may be used to summarize the information gathered in the 

analysis process. One chart is for products and one is* for processes. 

Summative quality ratings on the analyzed dimensions of several products 

or processes may be listed and compared to facilitate decision making. 

The two forms of the intrinsic analysis instruments are a short 

form, which is appropriate for practical use 1 and a long form which is 

i 

useful primarily during the process of acquiring the skill of performing • 
intrinsic -analyses. The long form includes questions which may require 
examining a particular ciimension from a slightly - different perspective 
than the analyst would use ba^d on the short form questions. It sup- 
plements and completion's the shp^t form and is useful in pointing up the 
many aspects of any product or process dimension which add td or detract 
from the quality of the dimension. 4 

Rationale for Intrinsic Analysis ' 
There are many reasons for analysis and evaluation of curriculum 
products and 'processes 1 of which problem identification in present programs, 
curriculum supplementation or new curriculum product or process selection 
are most obvious. For all of these purposes, .some already available^ an- 
alyses may be used before an independent intrinsic analysis is undertaken. 



Administrators may conduct analyses to support present programs 
before parent groups or school boards, although outcome data usually are 
used for this purpose. Analyses of programs may be used as a first step 
in their revision. Analyses may be 'a part of* staff preparation for 
accreditation. 
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There are two types of available analyses: 

1. ^Product catalogue descriptive information obtained from , 
developers deluding the following: 

a. NIE Product Catalogue. 

b. Educational Programs That Work (validated programs)* 

2. Analyses by teachers perforata under the auspices of pro- 

\ " *. ' ■ v 
duct information exchanges: 

a. Educational Products Information Exchange (EPIE) 

Product Information Catalogues. f * 

ib. Social Science Education Consortium's, QiAS analyses 

(Boulder, Colorado). - 1 

c. State-validated programs (e.g., An Evaluation of Instruc- 
tional Materials , San Mateo ^bounty Of f ice of Education, 

^ .» * ' 

v Redtteod City, CA. , 1974). ' 

/ ■ . i 

However, not only are rhese -analyses likely to provide less in- 

0 m 

formation than is needed for decision making in weighing the advantage 

of similar products or processes, they also are not applicable to the 

specific constraints and criteria and identified problems of the local 

site. Ah on-site intrinsic analysis of present program materials and 

» 

possible adpptions is jiecessary for making the most appropriate poss- 
ible choice for the following reasons: < 

\ 

9 1. Intrinsic analyses examine the instructional materials them - 

selves or materials used for teaching or managing (student texts, 
teacher manuals, workbooks, record forms, tests, etc.) rather than the 
outcome data or descriptions of the programs. 



2. Emphasis is on the dimensions identified as crucial to the 
identified local problem, making, the ^analysis a site-specific one. 

3. .An\ intrinsic analysis reveals the crucial elements of the 

> * - 

♦ , 

instructional models of potential innovations. This may be important 

fop effective adaptation and implementation. , 
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Constructs, Artifacts, Elements and Criteria ' 
The Constructs • f 

Opportunity, Structure, Motivators and Instructional Events are 

the four constructs employed in the PSIP process. Originally identi-* 

a, 

» 

fied as part of an evaluation .model developed for evaluation of class- 
room processes by William Cooley and Paul 'Lohnes (1976), the constructs 
„have been defined by- PSIP in terms-, of some elements (variables) that 

* • • ' 

are the same as those Cooley and Lohnes look at and some that are dif-' 
ferent because PSIP*s purposes are not evaluation of classroom pro- 
cesses but , ^rather, diagnosis of need and analysis of potential in- 
structional products or processes to meet. the identified need, ^U.1 of 
these constructs have been found to be 'related to effectiveness of 
instruction. Some of the variables which Cooley and Lohnes use to 
define* the constructs, however., are not used in the PSIP intrinsic 
analysis process (e.g., total time in school.br amquntof time spent 
on the subject un^der analysis.) Thc^e variables that used in ^ 
intrinsic analysis are thosd which are sft^licable to -the instructional 
materials themselves, ^bviously, curriculum materials do not usually 

k 

prescribe how much total time should be spent in school, nor ever^ how 
much time should be spent on the particular subject 'the material^ 
teach. * 

* * ; 

The instructional materials • themselves are the raw material for 
the analysis protess and 'the fir^t step in that process is the coi- 
lection of those materials or artifacts. 



The analysis instruments tell, the analyst the questions, to ask 

r * 

about each dimension* of the curriculum product br process but ftofc 
where to find the answers. The instruments are purposely constructed 
to be tools in the analysis process and therefore are as brief and ^ * 
■simple as possible. 'However , to Serve the nepds of the novice analyst 
who'may-not know immediately where to look for the answers to Che 

ai\alysitf questions , a chart of steps in performing an intrinsic ah- 

. ' .... ■ \ ' 

alysis has been constructed and appears, with t^e instruments, in the 
appendix. It ininSms listings of the ^W^J^i^^terials or. arti- 




facts that Ahpuld be gathered tp perform each step in the process* 

Wfilile la most instances, the questions make self-evident which , 
element of ~ the curriculum or. process should be looked at after the 
materials have been gathered , the following brief overview tells 
what artifacts to use for examination of which element to answer 

~ — ~ , . ; — 

which questions . It, therefore, provides a quick survey of the 
analysis process. 

ppportunity , The elements Of a curriculum which the analyst 
'examines to determine whether or not the, materials themselves sub- 

stantively provide sufficient opportunity for the student to learn 

» 

are the cohcepts, the content and the skills 'taught by these materials 

These niay be identified through' ^pr essed objectives or m&y be implied 

in the lessons and/or jteBt items* Therefore, scope and sequence 

charts, lists ^of course or unit objectives and 3 sampling of ' lessons 

* 

and test "items on those lessons should be collected and examined for 



r 



appropriateness and relevance of content, concepts, and skills For 

- ' • *' 
these students. - ' 

• » "i .1 » 

For opportunity through curriculum usage, a sampling of lessons 
and tests and management system record forms should be examined to 
determine intensity of treatment and adapt iveness ©^^instruction to 
student nteeds, * 

Motivators , The artifacts and elements of the curriculum which 
should be examined to determine whether or not* the materials provide 
sufficient motivators to encourage the students to learn are the 
following: " 

1. student materials (texts and workbooks) and student record 
forms £or opportunities for self-direction, self-selection, self-^ 
evaluation, program planning* 

2. teacher f s marfual fcnd s t ud«tf^ct i vi t i e s follow-up in , \\ 

workbooks and text, for intrinsic t^fetorcement and directions *to 

A 

teacher to provide extrinsic reinforcement. s 4 

.3. all materials, tox variety in format, method, mode, and 
strategies of instruction. 

* * 

Structure . The artifacts and the elements of the curriculum that 

should be examined to determine how well-structured the curriculum is 

i 

to assure that instruction builds on previous instruction towards 
terminal. goals, are the following: 

1, objectives, for their match to the characteristics and 
n^eds of students. / • * 

2. lessons, for their teaching to abjectives. 
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3. tests, for their match to objectives- and lessons. 

• * * 

4. scope and sequence chart, for how well objectives arfe, 

structured .and sequenced towards terminal, goal$. 

5. teacher manual directions, for the degree of guidance for 

• » • 

diagnosis and remedial treatment. m 

Instructional Events. The artifacts and the elements of the 



\ 



curriculum that should be examined to determine how well the materials 
teach and help th$ teacher to teach are the following*: 

1. teacher f s manual, for quality of directions to teacher and 
background information. 

2. student materials, for quality of directions to student 
and clarity of procedures. * 

3. management system record forms, for ease of use in managing 

* 

instruction. 

• % 

4. student materials, for appropriateness of instructional , f /- 
strategies for this population and adequacy of strategy usage. 

In summary, the elements ttt^e analyzed and their location in 
tfte instructional materials are shown below:. 

Elements Location 



Opportunity 



Concepts * 
Content 

Skills (behavior de- 
manded of student) 

Iris true tion 



Scope and sequence charts. 

Lists of course and/or 
unit objectives. 

Sampling of lesspns. 
Test items on lessons. 

Lessons, tests, record forms. 



Dimension 



Location 



Motivators 



Directions, selection, evaluation 
and program planning procedures. 

* 

Intrinsic and extrinsic rein- 
forcement process; 



Range of format, method, mode, 
and strategies. 



Student materials, student' „ 
record forma, teacher's manual. 

• ' f - 

f Descriptions of student activities 
and (directions to students. 

Directions to. teacher for inter- 
k action with students. 

* 

All instructional materials. 



Structure 

Objectives in relation to students. 

Lessons in relation to objectives y 

Tests in relation to objectives \< 
and lessons. J 

Structure of objectives 

Diagnosis and remedial treatment process 



Objectives 



* 



Lessons , obj ect ives f tests , 



Scope and sequence chart 
Teacher manual directions 



Instructional Events 



Teacher Instructional directions 
and background information. 

Student directions for instruction. 

Instructional strategies in 
relation to students. , 

Instructional strategies in 
reTaticn to research. 



Teacher' 3 Manual. 



Student materials. 

Management system record 
foms. 



Student materials, 
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Criteria 



The criteria* for, evaluation of curricula are based,; necessarily, 

on research <5r empirical evidence of effectiveness* The weighting of 

research and experience it* evaluating each distension must be a^ pro* 

fesfeional judgment of the analyst. However , the intrinsic analysis 

« 

process , by systematically focusing On jp limited number of dimensions 
(constructs) which research has shown to nuke a difference reduces 
the confusion of comparing diverse curricula to a reasonably manage- 
able process. 

This manual, in the interest of calrity and brevity, does not 
cite research, and the number of examples is limited. There is, 
however, an annotated bibliography which attempts to fill any gaps 
this expedient measure may create and, hopefully, to alleviate any 
threat of the manual seeming tfo be prescriptive without substantiation « 
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Analysis of Student Materials, Inservice Materials, Parent Materials 

Preparation and Previewing 

Preparation and previewing of a product or process is jarried out 
as it is described in the listing of steps in performing an intrinsic 
analysis. It would be pointless to repeat those steps here. However, 
some definitions and examples may serve to clarify this fitst procedure. 

One of the questions (Bl)* % is addressed to the relevance of the 
emphases of content, concepts and skills. By content, throughout the 
analysis process, we mean information, facts," events, people that ^re to 
be learned or learned about in the curriculum being analyzed. For example, 
J, f your school is looking for math- materials that heavily emphasize the 



metric system, you will respond to Bl that content^ is not appropriate .if 



the descriptive material or analyses you have assembled reveal that con- 
tent ignores the metric system. 

By*concepts, wemean categories of things (general ideas, usually 
expressed by a word) that aye organizing elements of a discipline. A 
concept in reading comprehension is theme. If this concept is considered 
essential by you and is mentioned in your assembled materials, and if a 
substantial number of other ^concepts which the analyst considers essential 
are also referred to, it may be safe to assume, at this point, that the 

1 T 

concepts are those appropriate for this school and its student population. 

By skills, we mean, both discipline specific abilities, such as the 
ability to decode in reading and general skills such as the ability, in 
any subject area, to apply, analyze, sjjmthesize, etc. If you expect your 
students to acquire higher level skills of analysis and synthesis and the 



Numbering system of analysis instruments. 

I KJ< . - 18 
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Instructional materials never demand that he or she analyze (a sentence, 
perhaps 'or synthesize (perhaps by writing an original story) , you would 
respond to ^Bl that the skill emphasis is' not appropriate to meet the needs 
of this school. 4 _ " - \ 

(Later in the process of curriculum analysis f we will describe how 
you analyse content, concepts and skills. For the moment, only, their , 
^appropriateness is examined.) 

Another question asked in the previewing phase of analysis (B2) 
refers to the match of the instructional method employed in the materials 
to be analyzed and its match to the theoretical and philosophical orients- 
tion 6f the teaching staff. 

By instructional method, in the analysis process , we mean the gen- 
eral orientation used to teach. For example, inquiry is a method. If^ 
you want your students to conduct research, to ask critical questions 
•about events and information rather than to 'accept without question every- 
thing they ate told, you would not respond favorably to materials that 
purport to be highly didactic. / 

Whether or not there are enough components available to meet the 
needs of the staff of the school which is using or contemplates using these 
materials and whether or not those that are necessary (tan be purchased 
within the school's budget is another important consideration for the 
previewing phase of analysis. 

All of these previewing questions may be applied to present mater- 
ials as well as to materials being considered for adoption. However, 
this last question .(B3) is. particularly important for present materials 

* \ 
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since its significance, so often is overlooked when something appears to 
be causing problems. Frequently, wit-h the blessing of salesmen who may 
endorse the use of a curriculum without a component which the school can- 
not afford to "buy, a school will attempt to operate without a crucial 
coinptonent / wuch as the |j:iter ion-referenced tests In a structured pro- 
gram. This could be the source oh the problem. To purchase a new pro- 
gram, possibly also without some key component % would be no solution at 
all. * ■ 

. If a curriculum requires an expensive variety of media including 

A : 

tapes 9 filmstrips, records, supplementary individual reading materials, 

J 

etc*, and if the school's budget is limited, then the consideration of 
whether all these components are necessary to successful operation of the 
program is extremely important. ■ 

The final question in previewing of materials (B4) is s^te specific. 
The constraints or criteria identified by the local action team* are 
applied to the particular curriculum under consideration. Whila\tocal 

• ' \ 

constraints and criteria are used in prescreening, that does not affect 
' \ 
•present curriculum analysis and even in the preparation for. selection, 

it is possible a candidate may have slipped through the screening even\ 

"• • \ 

though it did not .meet all the local school's constraints and criteria • v 
When the preparation and previewing phase is completed, the analysis 
of pfroducts or processes proceeds ^through each of the succeeding steps 
cqnstruct by construct, • 
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The Construct, Opportunity 0 

- *% f 

Unde* the construct, opportunity, the opportunity to learn based^on 

A- ' • 

the substance of the instruction , refers ftophe notion that time spent on 

appropriate instruction for' the student is opportunity to learn* Actual 

v 

t time spent, - as has been mentioned previously, is a highly important var- ^ 
iable of instruction, but is not a variable* that can be determined through 
an intrinsic analysis of materials themselves. The match of the content, 
concepts and skills to the needs of the students can be used to determine 
the substantive quality of time spent in instruction with these materials. 
That is, the opportunity these materials provide for these students to 
learn. 

IA. The questions asked to determine if the activities, content and 
concepts are appropriate for the student population so there is opportunity 
^ to learn are the following : 

1. Are the activities appropriate for the developmental level 
and socio-economic characteristics of these students? 

2. Is the content relevant to .these students? 

3. Are the concept examples provided relevant to £he students 1 
experience, needs, stage of instruction, so conceptualization can occur? ^ 

To respond to the first question above, it is necessary to find out 
from the assembled objectives and lessons what the student ^is' required to 
dp. An example of appropriate match of developmental level of student to 
activities would be for a student at Piaget's concrete level of operations 
(toughly ages 7-12) to manipulate concrete materials in executing math 

21 
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problems. An example of an activity appropriate to socio-economic level 
would be a substantial amount of oral responding for high socio-economic 
level students. - * % . 

yrfhe first criterion- of appropriateness is based on Fiaget's devel- * 
opmental psychology whic^h identifies developmental stages characterized 
by different capabilities- It also has been supported by research in the *\ 

.use of matiipulatives. The second criterion is based on a study by Brophy 
and Eveirtson whb found that time spent on oral responding is mose pro- 
ductive for high socio-economic classes. 

When the analyst has asked some of the questions irt these analysis 
instruments and examined instructional materials to find answers , it will 
become increasingly clear how these constructs may be applied to the 
analysis of materials (rather than the evaluation of classroom processes 
for whichC/fehe constructs were intended). For example, it should be 
♦apparent that if the activities in the instructional materials demand 

4 behavior which the students are not capable of performing, they will not 
have the opportunity to learn. 

Other specific criteria based on information known to the analyst, 
whether from empirical evidence. or research, can be used to determine 
whether the materials are appropriate for developmental level and socio- 
economic characteristics of the students. 1 Similarly, for every question 
in tife analysis instruments, the analyst's own knowledge and experience 
will provide breadth and depth to the process. 
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The instrument questions may suggest to administrators or- linkers 
possible inservice topics that the LAT might find to be of interest, such 
as the use of a consultant on Piaget's stages of development and their 
relevance to elementary school curriculum selection and/or an inseryice 
seminar on what research can tell us about the relationship between 
socio-economic characteristics and learning style. 

M 
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The question on content, relevance to the student (IA2) is not a ' 
• technical question, but rather demands knowledge of the student body as 
a whole, and of each individual student , to be aware of yfie range of 
their present knowledge, interest, iieeds and cbncerns. For example, rural 
students might uninterested in stories about city children if jthe 

stories assume some knowledge and understanding of urban problems which 

i • - 

the rural student does not have. Content which assumes this knowledge 
and builds on it could be confusing arid -uninteresting to the rural child. 
It would not provide opportunity to learn for this reason. This doesn't 
mean rural children want to (or 'should) read only about similar children, 

J 

but unless the content is presented in such a way that it provides suf- 
ficient prerequisite information to be understandable and X s presented 
interestingly, it seems irrelevant., and the opportunity/to learn could 

be lost. On the other hand, reading related to student interests should 

\ 

be rated as highly relevant. 

The third question under opportunity, substance (IA3) on whether 
concept examples permit the student to conceptualize is also related t& 
characteristics of the student including experience, needs and stage of 
instruction. Since each student f s experiences are different, when a new 
concept is introduced, examples of concepts are best chosen from in- 
stances that it is safe to assume nearly all the students will have 
encountered. Early in instruction, concept examples also should be most 
characteristic examples. That is, they should be examples which have the 
fewest irrelevant attributes. That technical-sounding term c^n best be 
explained with an example and my favorite example is whale. A whale is 



23 



17 



a mammal but many <pf its characteristics are not shared by other mammals. 
These characteristics which aye not shared with other mammals are non- 
defining (or non-critical) attributes. and so, are irrelevant. When first 
encountering the concept t mammal, such examples should be used as man, 
dogs, cats, etc. The range of examples should be extended as instruct 

tion continues. % 

• "V* 

If a, new concept is introduced with very.fewjjr inappropriate ex- 
amples, the student may under or over generalize so that he or she cannot 
recognize examples of the concept. Such instruction does not provide the 

'student with thfe opportunity to learn. 

i 

Of course, teachers often recognize this and supplement instruc- 
tional materials with their own examples. Nevertheless, in selecting 
materials, one basis for comparison may be the appropriateness of con- 
cept examples. 

Long form questions : One way to fifrther elucidate the intend of 4 
the instrument questions for each construct is to break the questions 
down into component elements, each a more precise question the analyst 
may ask of the materials ^Jbeing analyzed to get a better handle on their 
adequacy. The long form of the questionnaires is simply that - the 

i 

essential questions plus some further clarifying questions. 

The following are those questions for opportunity, substance: 
(They are numbered as they are in the long form analysis instrument.) 

IA1 a. Are all written explanations and directions for students 
simple, uncomplicated, straightforward and easy for this age -level to 
understand? 
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v b. Is, the objective of each task assignment expressed clearly 

for' the student to know explicitly what s/he must do, how well? If^'it ite 

not clearly .expressed, is it very obvious from the wording what behavior 

• • I* 

is expected and the level of performance required?* _ t 

IA? a. Doea the content relate plosely enough to the student's 

own knowledge tod experiences to build 'on them?. Does it offer enough new 

information to * provide opportunity to learn that can be related to m what 

( * * 

is already known? \ ■ 

b. Is there content (i.e., facts, information, events, people) 
% ♦ 
that you dean essential, which is left out? 

* IA3 a. Is there instructional material available to teach essen- 
tial concepts, written in vocabulary at the level of the lowest student? 
Has some of the instruction been planned to challenge the most advanced' 
student? 

b. Are concept instances selected so that early in instruction 
they have few irrelevant attributes (or characteristics that are not the 
essential defining characteristics of that concept class)? 

Are concept Instances, late in instruction selected which 
have more irrelevant attributes and hence ye more difficult to recognize 
as examples of the concept? 

c. Are there concepts (i.e., classes of things that are the 
important organizing centers of a subject) which you consider essential 
that are left out? 



- IB. • The questions asked* in analyzing phe. usage of" materials to* V 

... • ■ • • 

determine whether or not they. teach in a clear v focused, concentrated way 

and adapt to individual differences so that^ all* child* en^have the oppor- 

. •• - • • 

tunlty to learn are .the foll owing^ • ^ ■ - \*\ . • 0 * # . 

1. Do the materials supply oo'ncetit rated cognitive activity 
for the student to assure adequate opportunity to learn? # 

2. Do the materials provide the opportunity to learn for 

both slow and fast students and do they provide for different learning 

' " ,7 

styles? 9 ' - 

To answer these questions, samples of the objectives* lessons, 
tests and management system must be examined to determine how much of 
what the student reads, does (learning activities), and responds to 
(questions, tests) , <is what could be designated the curriculum materials * 
equivalent of "direct instruction." Another term^that may be used is 
"intensity of treatment" whicti may be defined as concentrated cognitive 
activity in lessons; criterion referenced tests written for clear, 
specific objectives; and a management system that encourages on-task 
behavior without undue delays for irrelevant non-cognitive activities. 

There is substantial support for the concept of "direct instruc- 
tion" which may be stated concisely as the engagement of the teacher in 
teaching the attentive student directly (Rosenshine, 1§76, 1977) "In- 
tensity of treatment" in instructional ifcaterials is a cpncept used by 
the author of this manual to denote the comparable, interaction between 
materials and students when the materials follow sound pedagogical prac- 

tices for adequate presentation, response, practice, review or evaluation. 

* * 
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This means materials which provide intensity of treatment are by definition 
those which provide ample opportunity for the student to learn through a 
kind of instructional materials form of ditect instruction. In addition, 
the teacher directions may support and provide directions for the concept 
of , direct instruction as Rosen shine defines, it. 

Teachers often describe instructional materials as "too easy" for 
this group or "too difficult" for that group.* Of course this jgay mean 

♦ 

the objectives are not appropriate. However, not infrequently the "too 
easy" materials are overly repetitious, contain reading that is irrelevant 
to the objectives, or contain activities that do not require the student 
to*' exhibit the objective behavior. Materials, in short, may be more 
filler than meat. 

* Occasionally materials designated "too difficult" may be totally 
Appropriate (if the objectives are suitable) although the intensity of. 

treatment which provides opportunity to learn may have seemed excessively 

0m * 

i , • 

intense cognitive activity to the teacher reviewer. 

/ Adaptability of the management system and the instructional mater- 
ials to individual differences in pace and learning style is another^ 
^ay that curricula Can provide opportunity to learn through materials 
usage* 

If the management system and teacher directions suggest self -pacing 
or^provide for review or recycling through previously studied materials 
if needed, they probably are reasonably adaptive. Learning style may be 
accommodated if there are choices <of method, mode and media. Moreover, 
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there shoula be instructions to the teacher^in'wJV'-to diagnose and 
manage this kind of variety . * • /, 



Long form questions : for clarify, focus* concentrated instruction 
and adaptability to individual learning differences: 

IB1 a. Is there opportunity provided to feajn each expressed 
or implied objective? , * , + ; " • " - 

b. Are thefe enough learning activities *\6 maximize the 
students 1 opportunities for learning? % [ * 



c. Do ^pie nfete^i'als suggest or prpviide sufficient direction 
to make possible direct instruction- (i.e., teacher-diitectfed instruction) 



a large part of the t^im$? r ^ 

IB2 a. Are the exercises and tasks* demanded of tih student diverse 
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enough so that students different learning styles caui.be accommodated? » 

b. jjo the instructional materials' supply enough practice for 

these students tcfc -learn? ' " * . 7 " ' • - ' 

\ ' ! - ' \ ' ■ * - 

t c. Does the management system suggested' by the materials 

i \ ■» 

permit adaptation to individual pace? *••,** ' » 



The Construct, Motivators - * 

~~ 

IIA. The questions asked to determine if the student has oppor- 

t unity for self-direct iori, selection, evaluation, which have been found 

Co be motivating , are the following: 

IV poes the student (parent, teacher) select instructional 

activities? + 

2. Does he or >ehe plan his/her program? 

3. Does he/she have an opportunity for self-evaluation? 
Opportunity fof self -direction, selection, evaluation may be high- 
lighted in the teacher's manual directions or spotted in the student's 
management materials. Self -selection of Instructional activities often 
is highlighted in developers' claims, and the management system and scope 
and sequence chart may be examined to identify the range of options for 
selection. Self-direction and evaluation may be identified by checking 
materials for answer keys to tests. There should be listings of follow 
up activities to tests, with students' directions for what to do next 
based on the score in the test. . 

The motivators construct as used for evaluation of classroom pro- ' 
cesses is divided info curricular motivators and interpersonal motivators. 
It would seem that the former would be important for intrinsic analysis 
of curriculum products while the latter would not be relevant to mater* 
ials. However, that is not so. Both are important to intrinsic analysis* 

Materials may suggest, either in the activities they provide or in 
the directions to the teacher in the instructor's manual, interpersonal 
motivators that are related to self -direction, selection, evaluation (IIA 1-3) 

29 ^ 
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Some of these could be the opportunity to tutor others or be tutored, to 
plan to work with others on self-selected aspects of the program, dfjt to 
evaluate others' work or to have others evaluate the student's work. In 
other words, while evaluation of classroom processes necessarily looks 
to planned or spontaneous classroom interaction as a source of data, 
intrinsic analysis of c utricular materials looks at interactipn which 
takes place between materials and students or which is prescribed in the 
materials for student/teacher or student /student interaction. * 

IIB. The questions "asked to determine if the materials provide 
reinforcement or instruct the teacher how and when to do so are the fol- 
lowing very straightforward* ones: 

1. Do the materials provide .reinforcement? 

2. Do the materials provide feedback? ' 

H 

Reinf orcement in the materials themselves is not difficult to locate. 
Often the student is promised that mastery of an objective may be followed 
by a desired activity. This is the well-known Premack principle, which 
suggests that any higher probability behavior (the desired activity) can 
be used to reinforce a lower probability behkvior (the work that leads to 
mastery of the objective). 

Teacher praise and punishment may be behaviors suggested in the 
teacher's manual with circumstances for their use as well as directions 
for how and what to do. The teacher 1 s manual may suggest the frequency 
and kind of feedback that should be provided. Feedback also is provided 
by the teacher in correcting oral or written work. Of course, an answer 
key is a form of feedback to the self-directed student. 
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IIC. The questions asked to determine If there is sufficient 
variety in the materials to appeal to student interests are the following : 

1. Is there variety in method, mode, format, and instruct 
tional strategies? 

2. Are there alternative paths through the materials to 
accommodate individual differences? 

3- Is content appealing to a range of interests? 

* 

4. Are materials functional, related to life experiences? 
Extent of variation in materials to encourage student interest id 
identified by straightforward examination of the methods used, the media 
and the teaching strategies. Teachers always have looked at instruction- 
al materials with their students 9 interests in mind. The research liter- 
ature describes the most popular reading for various ages. However, 
children's interests are as individualistic as their other differences 
such as pace, alternative path choices, preferred medium, etc. Each 
teacher can be the best Judge of such differences and analysis shbuld 
attend only to opportunity provided for a range of options and to site- 
specific interests! since each class will differ somewhat and ins true- , 
tional materials are' purchased for more than one class and more than one 
year. 

We know that novelty and change are motivating. Also, too great 
consistency in format can lead to students learning how to manage the 
system rather than learning the instructional content.' It can result in 
rote learning. Also, of course, the routine that is established by rep- 
etitions of identical activities with only the content changed can be 
boring.. 
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The last question was| added to the instrument because empirical 



evidence seemed to suggest that I in basic skills the -knowledge and the 
evidence through activities that^ bake it clearly apparent that the in- 
struction has utility are motivating to students. 

Examination of materials for adequacy of motivators is not as spec- 
ialized an analysis process as that required for any of the other con- 
structs. Perhaps this is because 'teachers are familiar with reinforce- 
ment, adaptation to individual differences and self direction, selection 

• » 

and evaluation as motivators; Also, the application of the opportunity 
construct to materials themselves is a specialized procedure and analysis 
of both structure and instructional events depends upon processes that' 
are not taught in most/" schools of education. 

Questions which appear under the construct, motivators, in the long 
form of the analysis instrument further define and clarify the concept. 
They follow: 

IIA1 a. Have the materials taught the student or provided guide- 
lines for the teacher to teach the student how to make appropriate 
selections? 

b. Is there any variety in procedures for making selections 
to Accommodate individual differences in self-directedness , complementing 
the teaching and/or guidelines in la? 

IIA2 a. Is the student allowed to plan his/her own time without 
prior instruction in how to do so? How adequate are the directions for 
this independent kind of behavior? 
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IIA3 a. Is there instruction in how to evaluate his/her own 
work? • 

b. Is the student eased into self-selection, self -evaluation 
in a step-by-step fashion appropriate to the developmental and experi- 
mental level of the student? * 

IIB1 a. Does the instructor's manual provide examples of appro- 

priate reinforcement procedures? 

» » 

* b. Does the student see the objectives or are there check- 

lists or soma recognition of progtess that the student can use to* monitor 

* 

his or 6 her success? - 

IIB2 a. Are the directions to the teacher for* providing feedback 
and motivators sufficiently clear and are the signals in £he materials 
for how and when to use them sufficiently attention-getting to encourage 
their use? 

IIC1 a. Are there too many activities of the same kind which 
might become boring to the students? 

b. Is the student allowed to tutor a peer or be tutored by 

a peer? 

IIC2 a. Do all students move through the materials in lock-step 
or are there opportunities for students to have unique programs that 
meet their needs? * 

b. Where there are a variety of possible pathways and in- 
dividual programs of study, are the teacher's directions adequate for 
t 

effective management of this Myriety? * 
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IIC3 a. If I were the age of these students, would I find these 
materials interesting? If I were of similar background and experience 

0 

* $s these children, would I probably enjoy working with these materials? 
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The Construct. Structure 

The construct, structure, is an extremely, important one and is ^ 
supported in the research literature, both from the perspective of the 
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instruction, and the organization of the classroom, as the IAT members 
well know. The structure of the instruction is the first concern. The 
first two groups of questions are primarily directed to that concern. 
Portions of the materials that facilitate maintenance of a well organized 
plassroom are the concern of the final two groups of questions. 

IIIA. The question asked to determine if there are specific ex- 
pressed or implied instructional objectives on which the Instruction is 
based is the following: 

1. To what degree does the instruction teach to the ob- 
jectives? 4 

If it is not possible to infeij, the objectives from the materials, 
the, Instruction would suffer from lack of direction. The presence of 
specific expressed instructional objectives very much facilitates the 
work of the teacher. If made available to the students, objectives tell 
them what they must do, under what conditions, and how well. These terms, 
of course,' define a well written behavioral objective. Yet, there is no 
specific question in the .instrument, as there are in most analysis in- 
struments, on whether or not there are objectives. 

The reason there is no such question is that the mere presence of 
expressed or clearly implied objectives is necessary, but of itself, not 
sufficient. The inability to infer objectives from the materials when 
they are not explicit is very important, as noted. However, the important 
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consideration for structure is how well the instruction teaches to those 
expressed or implied objectives. 

■ 

Sometimes objectives are quite general or are expressed ,as themes 
and skills.' In such cases, the specific objectives must be inferred from 
the student activities and/or the assessment instruments* For example, 
a theme may be "people live together in society." Clearly the concepts 
would be sociological. If the students' activities include reading about 
styles of living of different socio-economic arid ethnic groups in this 
country and the test questions ask for comparisons, one objective that 
could be inferred would be the following: Compare and contrast ways of 
living among various given socio-economic and ethnic groups in American 
Society. lit such fashion, one could make inferences about objectives if 
they were not expressed. 

A well structured set of objectives may lead clearly to the terminal 
goal, but unless the instruction ^aches to the objectives, the student 
cannot master them. This matching, at this point, is not related to 
psychological or pedagogical concerns, (which are attended under instruc- 
tional events) but only to the faithfulness of the match. For example, 
suppose one objective is that the student should be able to write a com- 
plete, complex sentence using descriptive adjectives and adverbs. If 
the student activities demand the writing of lists of adjectives and 
adverbs; the writing of simple sentences; underlining of subject and 
predicate; repeating the definition of a complex sentence; but do not 
require the writing of the kind of sentence the objective specifies, the 
materials are not adequate. Sometimes instructional materials list ob- 
jectives that are tested, for which the various necessary prerequisite 
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skills are taught , but they fail to Include activities which require the 
student to perform the terminal behavior demanded by the objective at any 
time during instruction. 

The structuring of the objectives is the most difficult aspect of - 
curriculum to analyze. It also depends most heavily on the model of In- 
struction the analyst adheres to. The process taught in these training 
materials is based on a structured-curriculum model of construction. 
Some interactive models of instruction may not be as pre-structured as 

i 

the structured-curriculum model presumes. However, some provision must 

< 

be made in any purposeful instruction with goals and objectives, for the 
instruction to proceed from entering behavior to terminal behavior, and 
research clearly supports small-step, carefully structured instruction in 
basic skills. — 

IIIB. The questions asked to determine how well the objectives are 
structured and sequenced to build towards the terminal goals are the 
following: > 

How well are the objectives structured and sequenced to build 
toward the terminal goals? / 

1. As indicated by a concept analysis? (sampling) 

2. As indicated by a content analysis? (sampling) 

3. As Indicated by a skill analysis? (sampling) 

To determine if the objectives are structured and sequenced to 
build toward the terminal goals (Bl, 2, 3), an examination of a scope and < 
sequence chart may be sufficient for identification of gaps or deficiencies 
in objectives which the analyst perceives as essential to achievement of 
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the specified behaviors. Or, on the contrary, such, a chart may appear 

to the analyst to be totally satisfactory or, indeed, to be more inclusive 

# 

than is absolutely necessary* 

When there is any question about any portion of the curriculum; 

* 

when a particular terminal objective has given trouble in the past with 
these students; or when there is not available an adequate (i.e. , explicit 
and detailed) scope and sequence chart, it may be necessary to sample 
expected trouble spots in the curriculum and do a comprehensive analysis 
of them. Even if the developers have provided an adequate description of 
the curriculum materials' structure, a comprehensive structural analysis 
may provide, the analyst greater confidence in his or her estimate of how 
well these instructional materials have been structured. 

If there is an expected trouble spot in the curriculum that is 
analyzed for structure, that same portion also should be* checked to be 
sure the instruction teaches to the objectives (IIIA1) and subsequently, % 

m 

that the testing procedures are adequate j:or that specific portion of the 
curriculum. This may require the analyst to go back and forth in the 
analysis process rather than to follow the step-by-step procedures in the 
prescribed sequence. However, this is an inevitable consequence of asing 
spot checking or sampling for expedience. 

m 

The processes of analysis described here ^re derived from the PIC 
Design/Analysis Model (Gow, 1976, 1977).' The three analyses are done sep- 
arately for both design and analysis, but are combined into an instruc- 
tional hierarchy for design. For analysis, the hierarchy may be the 
explicit objective sequence or may be implicit in the instruction, but it 
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is the Initial point of take-off for the analysis of structure (rather 
than the terminal «of the structuring process as it is in design). 

Although all this sounds complicated, It isn't. In less explicit 
terms, analysis \a the reverse process from design, and analysis of struc- 

ttire can begin with the objective scope and sequence chart or with the 

i 

instruction which is built on such an implicit or explicit chart. 

9 

Of the three analyses (concept, content and skill), the content one 
is easiest to describe and to perform because it is familiar to us. This 
is so because tlJfe familiar textbook table of contents is a logical order- 
' ing Of the curriculum content. Teachers examine the table of contents to 
determine what a particular textbook includes and -what it omits. The 
process of content analysis of a course, a unit or a lesson is the pro- 
£ess of identifying the teaching sequence of the content. The criterion 
for appropriateness of that sequence under this construct is the degree 
to which the content is ordered logically (i.e., temporally; simple' to 
complex; concrete to abstract; familiar to unfamiliar, etc.) and the 
appropriateness of step size between content objectives for the target 
population. 

Concept analysis is a more difficult process for most analysts. 
This is partly because teachers (and others) customarily consider the 
concept structure as identical with content structure. It is this sep- 
aration of content structure from concept structure that is the unique 
feature of the FIC Model, and it was conceived in recognition that one 
or the other may be emphasized but they may not both be equally well 
structured. 
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Toperform a concept analysis one identifies the major concepts 
taught irt a portion (sampling) of the curriculum and analyzes the process - 
(sequence) in which they are organized to be bujilt and combined into prin- 
ciples, -"generalizat ions and constructs. To perform such ~an analysis and 
to judgs the quality of the .organization of conceptual structure, it is 
preferable that the analyst be an expert and/or an instructor in £he.sub~. 
ject area being analyzed. If 'the 1AT includes one ctr more specialists' in 
this subject, their judgment probably should take precedence over that of 
a non-specialist. The conceptual structure of a particular discipline 
may be obscure to those to whom the discipline is not a major area of 
cotRentration. If the LAT does not include a^ specialist in this subject, 
it might be appropriate to consult one. 

The third kind of structural analysis that should be performed to 
estimate the adequacy of a curriculum's structure is a skill analysis. 
This analysis may be a fine-grained analysis of an early reading program, 
perhaps, using Gagne v s learning hierarchical sequence, or for most 
curricula, other than the early stages of reading or math, a Bloom hier- 
archy. To perform such an analysis, one examines the behavior demanded 
of the student irt any given sampling of the curriculum. 

If the lessons are preceded by objectives, the focus for a skill 
analysis is on what the objectives say the student will do. For example, 
the student will "name" is at the knowledge, or lowest level of Bloom f .s 
/Taxonomy. 4 The student will "translate into his or her own words" is the 
-second, or comprehension level, etc. The succeeding levels are applica- 
tion, analysis, synthesis and evaluation. 
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If there are no explicit, objectives, nevertheless what the student 
does to carry out the lesson' activities Is the skill. Each, behavior 
tphich demonstrates he or she has been Instructed, by reading, writing, 
talking, interacting with students, teacher or others, or manipulating 
the instructional materials provided, is one step In the hierarchy of 
skills that is the framework of the instructional sequence. 

A finer grained analysis may be necessary for some student behaviors, 
especially those demanded in early reading, for example. Gagne's hier-~ , 
archies may be better suited for such an analysis. For example, Gagne 
labels learning of language sounds as stimulus-response learning, the 
lowest level in his hierarchy. Recognition of printed letters by sound 
is at his second level : chaining . « Multiple discrimination includes dis- 
titiguished similar words. 

For levels higher than multiple discrimination, it is better to use 

Bloom's levels. Indeed, Gagne's S-R, chaining, and multiple discrimina- • * 

' ' 1 

tion could be considered subcategories* of the knowledge level of Bloom. 
The order in -which behaviors should be structured in any given 

* ' t 

sequence may not, necessarily, be the ordter in which every child will 
leajn^ best. When a designer develops his instructional sequence be at- 
tempts to provide an optimal sequence based on logical, psycholf gical and 
pedagogical considerations. 

For the analyst, the Construction of such a sequence is not at issue. 
The analyst's task is to identify gaps^hnd deficiencies if they exist. 



^Bloom's Taxonomy levels and Gagne's hierarchy levels are in the 



exhibits ^ip-the appendix of the manual. 
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Since content, concept and skill analyses have been described here, are 
outlined step-by-step in the chart of procedures, and are practiced in - 
the exercises at the end of this manual, it will suffice, at this point, 

■ • ... 

to provide examples of how possible gaps or deficiencies might be identic * 
fied. . 

Gaps or deficiencies might be found to exist in content, concepts 
or skills under any of the following circumstances: 

a. If the analyst, in performing the analysis finds that a piece 
of essential* information in the content sequence 9 or an essential skill 
is presumed to have been previously acquired by the student although the 
analyst is aware it is not in the repertoire* of these students, (e.g., 
the students are to read stories with many unfamiliar words Which they 

must sound out, using context for meaning, but have had little or no ex~ 

• * * 

perience deriving meaning from context in simpler problems. The student 

is expected to find information in the library, but has not acquired 

library skills.) 

b. The analyst discovers that one or more of the three analyses 
(content, concept, skill) reveals "the developer has omitted an important 

a 

step in the instructional sequence, (e.g., the relational terms above, 
below, behind, before are being taught. , The hierarchy includes objectives 

* 

to teach each term separately in relation to a concrete object, to teach 

■> 

discrimination among the £erms taken together in relation to a concrete 
object, /to teach .the terms in the same order in relation to an object on 
a page in a book and on a chart on a board. Left out of the sequence is 
in&truction in these terms in reJ^ion to the student himself.) 

• • 42 ' 

' " 1 *. 
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c. The Instructional hierarchies are all truncated. They teach at 
the knowledge and comprehension level only. Students are seldom asked to 

* 

apply, analyze, synthesize. They may, on the other hand, he asked to 

4 

synthesize without any steps in between comprehension and synthesis* 
(e.g., the terminal objective is to write a poem, whi^Ji is a synthesis 
level objective. The students have been asked 9 in the other steps lead- 
ln§ up to this, to read poems, recite poems they have memorized , and tell 
the meaning of poems. The highest level is translate: comprehension. 
However, they. have never learned rules for writing poms, applied each 
of thdn, and analyzed poems to identify how the rules had been applied 
by the poet. Had these tasks been part of the hierarchy, it would pro- 
gres& from translation .to application and analysis before reaching 

synthesis.) • - , " 

• ** 

These examples were purposely 1 chosen because they are kinds of 
omissions teachfers customarily take care of almost automatically and 
because they ar N e not gaps recognizable only t9 a specialist in reading 
or math. Teachers plug gaps daily. However, materials that require such 
measures are inferior in construction to those that do not. Some pf the 
gaps might require filling only %pr the student who has trouble learning. 
Some may not be as readily recognizable as these examples and yet they 
may be cruci^L% 

Determination of the presence or absence of a testing procedure 
and its adequacy is essential to structure since the student's progress 
from one objective to the next objective hinges on mastery of the first 
orife before he can work on the subsequent one. 
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XXIC. The questions asked to determine if there is a testing pro- 
cedure adequate to determine mastery of the objectives are as follows: 




1. How well do the test items 9 observation guidelines or 
other mastery criteria match the Implied or explicit objectives? 

2. Are all objectives, started or implied, measured orf checked 
by observation and are criteria provided? 

a. affective? 

b. cognitive? * w 

c. psychomotor? 

The first of these questions refers to the match of the expressed 
or implied objectives to the test items. ("Are the test items indeed 
criterion-referenced? 11 is essentially the question.) A test ipem may 
demand behavior that is something less than, different from, or more than 
the objectives specify. In any of these cases, the structure of the cur- 
riculum, as defined by the objectives scope and sequence, is weakened and 
must be judged inadequate. 

In the case of affective objectives, usually there is no testing 
procedure possible. However, if the objectives are well-written it is 
possible to identify observable (through not testable) behaviors accept- 
able as evidence of achievement of the objectives. Sometimes these are 
provided by conscientious developers in the form of observation guide- 
lines and/or checklists. The second question attends to each domain of 
objectives, if domains other than the cognitive are relevant. Furnishing 
of criteria for evaluation of objectives by the developer is very helpful 
to the teacher.' 
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While this discussion of structure has centered on analysis for 
structure of new materials, the match of instruction tests and objectives 
is of major concern in the analysis of present program as well. In addi- 
tion, the use of standard achievement tests may cloud the issue by call- 
ing attention to supposed inadequacies that may be real or may be simply 
the result of adequate, instruction for different objectives. 

For example, if you feel you have a problem In mathematics because 
your standard achievement scores are low 9 but y on the either hand, the 
items in the standard achievement test do not match your objectives or 
your instruction, therfe may be no problem at all, unless it is a problem 
of redefining goals and objectives or selecting different tests as the 
measures of progress which are valued by the school* You simply are not 
measuring what you teach. That is *an administrative problem, not an 
analysis problem. Similarly, if your instruction does not match your 
objectives, you are giving lipservice to behaviors you are not teaching 
and probably cannot hope to have students reach the goals to which those 
behaviors are prerequisite. 

All of this seems obvious and therefore to mention it seems un- 
necessary. However, this often is not considered in analyzing present 
materials and selecting new ones. In the preparation and previewing of 
materials, the content, concept and skill emphases and the Instructional 
method appropriateness to your school (match to your students and teach- 
ers) has been considered. This is one kind of matching that is important 
to the intrinsic analysis process. Often in the examination of instruc- 
tional materials, the expressed or implied objectives are evaluated sep- 
arately from the instruction and the curriculum tests without considera- 
te 
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tion of their interrelationships. /The closeness of match of objectives, 
instruction and curriculum tests, however, is one measure of quality of 
structure. As any curriculum designer well knows, objectives and tests 
usually are written before the instruction or lesson is written. Tests 
simply ask that the student demonstrate the behavior described in the 
objective. Then lessons are designed to teach to the objective. 

It would seem that determining the match of objectives and tests 
would be an easy task. For some reason, it is not. Probably that reason 
is habit. Certain behaviors are tested in certain ways which may be in- 
appropriate* but which have been unquestioned except in university classes 
in testing* Progress through a well-structured curriculum cannot be 
measured if the three way match (objectives, lessons, tests) does not 
exist. Therefore, to determine if a curriculum is or is not well- 
structured, the analyst must be able to master the skill of identifying 
such a three-way match or lack of it. Some exercises at the end of this* 
manual are designed to provide both practice and a check on your ability 
to carry out this analysis task. 

Long form questions : The explanatory value of the more precise 
questions in the long form instrument for the construct, structure, prob- 
ably will be greater if the questions on the first three portions under ' 
structure (ABC) are listed here. This is so because these refer to the 
substance of the materials while the final portion (D) refers to the 
props provided the teachers in the use of the structure for organizing 
the Classroom. These additional questions follow: 
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IIIA1 a. Do randomly selected objectives have matching instruc- 
tional materials which both teach and require demonstration of the identi- 
cal behavior described by the objective? 

X1IB1 a. For each generalization which is a part of an 'expressed 
or implied objective are the component principle and concepts taught? 

b. For each principle which is part of an expressed or implied 
objective are the component concepts taught? 

IIIB2 a. When content previously encountered i^tbe subject matter 
of later instruction* are references made to the earlier instruction to 
help build cognitive bridges and instructional structure? 

IIIB3 a. Do the behaviors required of the students fall within 
the same taxonomy levels or are all levels of behavior sampled, when this 
is appropriate? f , 

IIIC1 a. Axe there self-test items in end of chapter and/or end 
of unit, or other curriculum tests which demand the behavior expressed 
in the selected objectives so the students are made aware of what mastery 
tests will require for progression? 

IIIC2 a. For expressed affective objectives, is there any guidance 
in determining how-to judge whether they have been attained? Is more 
than one example of criterion behavior supplied in the teacher's manual 
or in other guidelines? 

b. When a concept is taught, is it tested by requiring the 
student to distinguish between examples and non examples and to generate 
a new (e.g., untaught) example? 
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c. When a principle is taught, is it tested by requiring 
recall of component concepts, by requiring stating the principle and/or 
by asking the student to apply it, or describe how it could be applied, 

« 

or to describe cases where it would or would not be applicable? 

d. In generalizing, do students generate their own examples 
of the generalization? . 

e. In problem solving, do students select the appropriate 
principle and solve the problem? - 

HID. The questions asked under section D of the analysis instru- 
ment, designed to determine the quality of the guidance supplied by di- 
rections t6 the teacher in instructional materials and the teacher's 
manual are the following: 

1. How adequate are the props which the Instructor's manual 
provides to guide the teacher in diagnosis of student needs and for 
placement and progression? 

2. How adequate is the guidance supplied by the teacher's 
manual for alternate, remedial or supplemental instruction for students? 

3. To what degree do the range of the objectives alone or 
the objectives combined with the remedial or supplemental instruction 
match the range of the student population? 

The first two questions require an estimate of the adequacy of the 
help which Is furnished in the diagnosis of student needs . Does the 
teacher's manual tell you how to judge where the student should begin, 
how you will know when he or she should move on to a new task and which 
task? Are there alternate materials, remedial materials and/or supple- 
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mentary materials In the program or are there suggestions for what you 
can do to offer each of these as needed by your students, as well as 
suggestions for how you can tell that they- are needed? Any part of these 
questions to which the response is "no" should be considered a valid 
reason for judging* the quality of this dimension as less than satis- 
factory. 

Even if the structure of a program fs perfect, i£ there is no con- 
aider at Ion given to -how each student uslpg the program will progress ' 
through it. it cannot be considered well-structured. Even w^th adequate 
structure and options for alternative, remedial and supplemental ins t rue ~ 
tion, if the teacher is not Informed about 'how to employ these alterna- 
tives, he or she; cannot be expected to provide optimally structured in- 
struction. 

The final consideration, under this construct, is the degree to 
which the range of the instructional objectives, including the above- 
mentione4 options, meets the range of needs of the population to be 
served (IIID3). If the materials under consideration fail to meet the 
needs of any considerable segment of the school population, it would be 
economically unf feasible to purchase them. Supplementing the materials 
could undermine their carefully structured sequence as much as could a 
. failure to use them appropriately because of inadequate instructions. 

Long form questions which further explicate this portion of the 
structure questions are the following: 

IIID1 a. Is there a scope and sequence chart to provide an over- 

* 

all picture of "the structure of the instruction? 
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IIID2 a. How readily can remedial or supplementary materials be 
plugged into this structure? Does some simple and feasible coding 'system 
appear to be possible for facilitating use of all available materials 
which can be fitted into the curriculum structure? 

* 

b. How well does this course, as it Is structured, fit into 
the total school curriculum in this subject, especially the immediately 
preceding and succeeding courses? 
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The. Construct, Instructional Events 

The final construct, instructional events, is restricted to consid- 
eration of how the materials teach and what they tell the teacher about 
how to teach. Some instructional materials fail to take the teacher into 
the designer* s confidence. The instructional methods, and the philosophy 
behind them, may have been briefly mentioned in a forward or in advertis- 
ing literature, but often the specific strategies used in the student in- 
structlonal materials are not identified and the rationale for them is not 
revealed. This is unfortunate, since the^ teacher cannot support and may, 
indeed, defeat the purpose of strategies of which he or she is unaware. 
It is hoped that the skill of analysis, as taught in these materials, may 
help teachers to identify the Strategies which developers have employed 
and have not described for the user. 

The instructional events construct is divided into substance and 
usage. Instructional events, substance, refers to the quality of methods 
and strategies used in instruction and the quality of support given the 
teacher for monitoring instruction which employs these methods and strat- 
egies through explanation of how and why they are used. The Intrinsic 
quality of content concepts and skills taught is also a concern under this 
construct as well as the efficiency of the management system which keeps 
the instruction, in the materials functioning so that students and mater- 
ials are interfacing to the maximum possible exteftt. 

Instructional events, usage, is the element in these instruments 
that calls upon the analyst 1 s background knowledge and experience in in- 
structional psychology and all the possible input from the PSIP agencies 
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to update the analyst's knowledge and understanding of what research im- 
plies for practice . Here the most recent prescriptions for hov to teach 
the subject being analyzed can be plugged into the process. 

IVA. Instructional Events (substance). To determine if the teacher' 
manual provides sufficient teaching assistance the following questions are 
asked: Do the materials provide: 

1. information on methods? 

2. information on strategies? 

3. background information, vocabulary (definitions of terms) 
and procedures? x 

If the method used throughout the materials is inductive and the 
student is expected, through examples, to learn a concept or to acquire 
an understanding of how a principle wqrks the instructor should be Informed 
that this is the method use^tnd the rationale behind it. Usually, for 
young children, a concept that is abstract is taught inductively because 
the child is still at the stage of concrete operations. Some children 
might be thoroughly confused by a teacher who was not informed that this 
was the method used and who attempted to define, and teach the children to 
de%ine, abstract concepts they could better learn to induce from the ex- 
amples given in the materials, 
i 

Some developers are very conscientious in providing teachers with 
the rationale for their selection of methods and strategies and include 
background information that can be most helpful. An example that will 
illustrate this point may be found in the Individualized Science Program 
(IS) developed at LRDC. In a level A lesson designed to teach the student 




to explore alternate ways of sorting objects and to explore the concept > 



of class inclusion, dote in the following description the tremendous 
teacher support offered in the background information: 

The lesson activity is built around a kit containing a bouquet 
of flowers. The students' name the flowers, s6rt them, are asked to 
suggest other ways of sorting them and continue until they have run 
out of suggestions for sorting, (e.g., Bouquet: flowers, leaves, 
Bouquet: roses, daffodils, carnations, philodendron leaves, dahlia 
leaves, etc.). . 

Then the suggestion is bade to the teacher that the examples 
given are 4 made in one sort and multiple sort could be introduced 
by asking students to sort the flowers by kind and the leaves by 
kind, and then the flowers by color. 

Other suggestions are made: to draw a chart, to ask questions 

such as "are there more roses or are there more flowers? Are there 

moj;e red carnations or are there more leaves? 11 

• Finally, there is this note: ~ 

This DGA* is not designed to teach the student how to 
answer these questions, but rather to explore the idea 
of class inclusion. When asked, "Are there more roses 
or are there more flowers?" it is fairly typical for a 
student at this level to answer that there are more 
roses. He looks at the three classes of flowers and 
notes that there are more roses than daffodils and more 
roses than carnations. He is comparing the number of 
flowers and that, therefore, thefe are more flowers than 
roses. Dori f t tell him that his answer is wrptfg, but dis- 
cuss the answer with him. ^Ask him questions that will 
• help him identify the class of flowers and £he class of 

roses. If you are interested in reading more about this 
behavior pattern in children, it is discussed in detail 
in books by Jean Piaget and in books about the work of 
Piaget.) 



* 

Directed group activity 
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IVB. To determine intrinsic quality of content, concepts and skills, 
the questions ask for an estimate of: 
" 1. .content quality. j 

2. concept quality. j 

3. skill quality. 

/ . 

To examine content , concepts and skills for substantive quality Is 
not the same as the examination of these same elements for their match to 
the school 9 s goals which is part of the previewing phase of materials an- 
alysis. It is different from the scrutiny of the same elements for the 
opportunity they provide for learning because of appropriateness and rel- 
evance to student experience needs etc. The perspective on these three 
elements (content, concepts, skills) ix? this instance is also different 
from that involved in the analyses 'dope * for evaluation of structure and 

the examination of their appeal as mo tivators . It is an examination of 

I 'I 

the intrinsic quality of the instructional content, corfcepts and skills 
and the instructional events in which they are embedded. 

Skills may not be rated of high quality, for example, if consistently, 
throughout the materials, they sample only knowledge and comprehension 
level behaviors. Teachers often speak of materials which hav£ this fail- 
ing as requiring "only memory w6rk." 

Judgment of content and concept quality teitds to be rather subjective 
or to be very much contingent on the analyst's philosophy jof education or 
his or her methodological orientation in the subject field. For example, 
which particular lette/^ sounds should be taught at the beginning of in- 
struction, and how many should be taught how fast, are theoretical 
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questions which could draw forth four or five different responses from 
four or five different experts. The advocate of a linguistic approach 
might respond differently from the advocate of an information processing 
approach or an eclectic approach. Dr., Isabel Beck and E^len McCaslin, in 
analyzing eight beginning reading programs, found that the phonics in- 
st ruction in four basal programs (Ginn, Houghton Mifflin, Bank Street 
and Open Highways) was inappropriate for compensatory education students. 
This was based on their analysis of ,the phonemic analysis instruction in 

these programs. It was also based on their belief in the necessity of 

* - 

very careful and explicit teaching of phonemic analysis skills. In short, 
how one judges the intrinsic quality of the instruction in student mat- 
erials is affected primarily, by the methodological orientation of the 
analyst. 

IVC. Questions asked to determine if the management system Is 
efficient enough to support the quality of instruction are the following: 

1. Can students ^work steadily without delay or threat to 
the effectiveness of instructional events? 

2. Can teachers manage instruction without frequent break- 
downs in the system? 

These questions deal with the level of support provided by the man- 
agement system for the instructional events evaluated by the previous 
questions. No matter how good the quality of content, concepts and skills 
as me asured against current expert opinion or research, if the management 
system is not\ef f icient enough to support the effectiveness of these 

instructional events or the teachers cannot manage the system, because 

* 
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of its complexity, without frequent breakdowns, the quality of this in* 
struction will not pay off. 

For example, let us use v again, the Beck, McCaslin report on reading 
and the explicit teaching of phonemic 'analysis skills* Usually, this in- ' 
volves the teacher holding up cards and modeling the sound iftg-out process. 
In an individualized program, the management system must permit the teacher 
to carry out this instruction with large or small groups • as needed while 
others are occupied in other activities. To be effective^ the system 'dust 
support the variety of activities required without a breakdown. 

Jn the ECRI program, ^f or another example, the highly structured 
process includes sounding out the word aloud, spelling it and writing it. „ 
The invariant characteristic of the procedure helps to make it work, the 
students very quickly learn what is expected of them and the teacher's 
ability to check out responses of several children spewing in unison and 
writing simultaneously is tremendously facilitated by this invar lance in 
the system. 

Judging the management system's adequacy is difficult without seeing 
it in action or trying it out. However, as in judging the quality of 
'teacher props in the first grouf> of questions on the substantive quality 
of instructional events, the amount of effort that is put into supporting 
the teacher with rationale, detailed procedures, alternatives, and sug- 
gestions of what may be expected from the students in their response to 
the instructional events, often is a prediction of how effective the 
system will be in operation. 
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Long form questions : The questions that further clarify the intent 
of instructional events, substance are the following: 

IVA1 a. Do the instructions to the teacher specify whether or when 
the materials teach inductively or deductively? Do they indicate if a 
discovery, guided discovery or individual inquiry method is used? Are - 
they used in accordance with appropriate pedagogical procedures? 

IVA2 a. Are instructional .strategies ever mentioned at all in 
descriptive or teacher materials? If they are not, it must be assumed 

that the teacher's cooperation is not required for effectiveness unless 

. •' ; ' ' ' 

there is evidence to the conttary. \ \ 

IVA3 a. When the materials require an introduction by the teacher 
or a synthesis, 1^ the required information supplied for him or her or 
must the teacher supply it? 

b. In presenting any information to the teacher on methods or 
strategies, are all ter$s defined and all procedures described? 

IVB1 a. Does the teacher who will teach from these materials feel 
that the content is .what should be taught in this subject to these child- 
ren? What do the experts say the issues are? Taking these issues into 
consideration is this the content you would choose? 

IVB2 a. Are these the concepts scholars in the field recommend 
should be taught to children at this stage of their development? 

IVB3 a. In order to tfeach the children learnlng-to-leam skills, 

> 

are all taxonomic* levels sampled in these materials? 
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IVD. Instructional Events (usage) . The last two questions in the SIP 
form of the intrinsic analysis instruments relate to the usage rather than 

the substance of the instructional events. The questions asked are the 

4 

* 

following: Are the instructional strategies and methods appropriate for 
this student population and are they used effectively? 

1. Appropriateness of strategy selection and usage? 

2. Appropriateness of methods selection and usage? 
Methods , of course, may be chosen because of the kind of students 

the materials are to be used with or the nature of the subject matter. 

For example, a deductive method of teaching an abstract concept may bf 

most expedient for adult learners when the same concept would best be 

taught inductively to children not yet at the stage, of formal operations. 

Inquiry might be the method of choice for an eleafentary school science 

program which claimed to provide hands-on experience # manipula ting sub-' 

stances and machines and attempted to develop curiosity about natural 

phenomena.. A deductive approach would be inappropriate in such 'a case. 

Strategies that would be most appropriate with one student population 

might fail miserably with a different population. 

A raathetics (or backward chaining) approach might be very effect- - 

ive in .teaching a' young student a memorization' task such as learning to 

recite a poem. For an adult student in a poetry appreciation class who 

would find that approach tedious, it could be more effective, and better 

suited to the purpose of the course, to teach it by asking .the student to 

analyze the poem, identifying the major concepts, the rhythm and the 

« 

rhyming pattern, and then to use these to facilitate recall of the poem. 
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There is only one long form question under this portion of the 
instrument, but there is also a list of strategies for the analyst to 
check out and to supplement with his/her own favorite strategies. 

IVD1. a. If the materials claim to use certain instructional strat- 
egies, do they also tell how they are used so you can judge the approprlat 
ness of selection and usage? 

b. Following are some instructional strategies that you might 
want to check for and to ask yourself: Are, they appropriate here and are 
they used correctly? 

small steps 
cues and prompts 

questions distributed through instructional materials 
(rather than only at the end) 
# advance organizers 
backward chaining 

concept-learning strategies based on range of instances 
subject area specific strategies such as modeling in 

blending 
practice 
reinforcement " 
feedback 

Summary of Criteria 

Criteria for prescreening are essentially those identified by the 
LAT. Constraints must also be considered. Procedures for prescreening 
require matching of the identified philosophy goals and objectives of the 
school with the emphases in content, concepts, % skills and instructional 
method of the materials. 

Appropriateness and relevance of the activities, content and con- 
cepts to the student population and degree to which they teach all child- 
ren in a clear, focused, concentrated way and adapt to individual differ- 
fence are criteria for evaluating the amount of opportunity the materials 



being analyzed would provide for students to learn. The appropriateness 
should be in terms of all the dimensions along which children differ which 
may be related to learning, if we have some knowledge of the way to deal 
with these differences. 

How motivating the materials may be is judged on the basis of the 
amount of self direction, self selection and self evaluation; the rein- 
forcement provided by materials and suggested to teachers; feedback to 
students on their work; variety; interest, and functional quality. * 

Structure quality is based on explicitness of objectives and their 
match to lessons and tests; the appropriateness of the content, cpncept 
and skill sequencing; and the adequacy of guidance supplied for the 
teacher in diagnosing and in remediation. 

Instructional events are evaluated on the basis of the quality of 

assistance provided the teacher on methods, strategies and background in- 

« * 

formation; the quality of instruction intrinsic in the materials based 
on what research suggests as effective; and on the efficiency of the 
management system to support this quality instruction. The appropriate- 
ness of the use of the instructional strategies and methods for this 
# 

particular population, and in the suggestions to the teachers for^ use of 
these strategies and methods, are the final criteria for analysis. 
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Analysis of Management System , Practices or Processes 
When a curriculum product is analyzed, as was described in the pre- 
ceding pages, the built-in management system (if any) of that product is 
analyzed concurrently. However, when a school contemplates the adoption 
of a new instructional practice , such as a method for individualizing 
instruction using its present" materials, the kinds of questions one asks 
are different. This is so 4^8&use the system , practice or process used is 
the primary focus rather than the students, parent or in-service instruc- 
tional mater iala^whicff are the primary focus of a curriculum product . 

If the management system is the sole change from present program, 
the burden of proof that the innovation will result in improvement rests 
entirely with the system itself. Therefore, a special instrument has been 
developed that attempts to direct the attention of the linker and the LAX 
to the salient questions about the system, to help determine whether or 
not it would be a feasible solution to the school's problem. An example 
of a management system is IGE, Individually Guided Education. 

In some instances , Y schools may contemplate selection of practices or 
processes rather than a management systefe. Such practices might be special 
procedures for teaching teading, such as the ECRI system. This is mo^e 
than a management system/ It is a special set of instructional practices. 

The Management Systems, Practices or Processes instrument (MPP form) may 

« 

be used for sets of practices or procedures as well as for management 
systems. I LA, Individualized language arts, also is a set of procedures. 

The particular artifacts which must be assembled for the intrinsic 
analysis of a management system, process or practice are the student and 
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class record forms, the teacher's manual or other handbook to provide guide- 
lines for implementation o£„ the system, process or practice and any objec- 
tives or tests provided by t he deve lopers. Rationales produced by the 
developer may be' especially helpful. If training is supplied, it would be' 
most helpful to have a description of the training program, or, better' 
still, the program itself if it is a written one. Except where indicated - 
specifically in the following commentary on the analysis process, any or 
all of these assembled materials will have to be examined to respofi to" > 

C 

the questions in the management system, -practices or processes instrument. 

— H - • 

Preparation and Previewing ; 

** - 

m ♦ 

As in using the SIP form of the instrument, the first steps in pre- 
paration and previewing are to determine appropriateness for the particular 
site and the match to the theoretical and philosophical orientation of the 
staff. The wording of the questions is the only difference between the 
two forms. For products, the emphases on content, concepts and skills 
are matched to the school's emphases and the instructional method is* 
matched to the philosophical and theoretical orientation of the teaching » 
staff. The processes or systems form of the instrument addresses the same - 
concerns but the questions ask about appropriateness of the management 
system, practice or process aqd the match of the practice or process to 
the theoretical orientation of the teaching staff. 

Clearly, there may be differing philosophical or theoretical orien- 
tations among staff members, but they must be resolved during this pre- 
viewing stage if the selection team is to reach, a consensus on a product 
or process all members can work with. 
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The Construct, Opportunity — 

XA. The questions asked to determine If this system or practice 
provides more time for learning are the following: 

It. To what extent does the system or practice give the student 
more on task time? 

2. To what extent does the system or practice give the teacher 
more time to teach actively or to guide student learning? 

The degree to which a system or practice permits more on task time 

V 

< for the student is crucial to the effectiveness of the innovation since 
more on task tiro provides the student with greater opportunity to learn. 

Obvious as that sounds, it is a factor -Jtjtat fb being emphasized by many 

. / ^ ' t ' - 

? of \fie recent majojr research studies Which, rather apologetically 9 report 
\. ^ ■ 

i - % . * « 

that the more time actively engaged in learning a particular subject;, \the « 

greater the achievement in that subject. It does need to be reiterated, 

♦ in spite of i£s seeming to be clearly evident , that of course students 

learn bette^ if they are actively engaged in learning than if they are not:. 



We tend^to carry on more and more activities in the classroom that are not 

cognitive. Many of these may be management activities. l£ a system Is 

■ 

clear and simple, or it its complexity is so designed that when fully 
functioning it provides the student with adequate time for cognitive act- 
ivity, it probably should receive a high quality rating for opportunity. 

Similarly, if a set of procedures supply concentrated on-task time 
for the student, they are likely to facilitate learning and the opportun- 

i 

ity quality rating for the process should be high. 
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The extent to which a practice or system gives the teacher more time 
to teach (i.e., to engage in direct instruction) or to guide student learn- 
ing is the next decision whidh must be made and a quality rating must be 
generated. 

Among the management system artifacts that may be considered, advan- 
tages which are likely to provide teaching time (as opposed to excessive 
management time) for teacher are the following: 

f 

a) a scope and sequence chart which Includes Indications of reme- 

i+ - ...... 

diatlon, supplementation, and branching sequences- 

b) notes to the teacher, either in the teacher manual or teacher's 
edition of the instructional materials, on what the student's options are 
at the conclusion of each lesson, unit, section of the course. 

• c) notes to the student on how to correct his/her own work and 
what to do next. / 

d) simple record forms for students providing scores or indication 
of master/ and a record objectives completed and in process. 

• m ■ 

e) - class record forms which show r preferably at a glance, where 
each, Student is at the moment. 

tf the class Is not individualized, i^i^ none- the- less important 
that any management system provide teacher props to make it as easy as 
possible for" the teacher to know where each student is in the program of 
instructj^jfn. If the records are based on groups rather than individuals, 
it is still essential that the system provide a systematic way of keeping 
track of each student. The only difference with groups is that students 
may stud^ and move in lock-step rather than individually. a 
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IIA. The questions asked to determine if the system or practice 
offers advantages to both student and teacher which will encourage co- 
operation in implementing it are the following: 

1. To what extent does it save "the teacher time and/or effort? 

2. To what extent does it help the teacher teach more ef fee- 
tively? m 1 ' . 

3. To what extent does it help the student spend more active 

y 

time in learning what he/she finds interesting? 

The consideration under the construct, motivators, is very much re- 
lated to and may be based on the information generated in 'analyzing oppor- 
t unity for learning". • However, here the focus is the degree of motivation 

■* 

that is generated by the freeing up of the teacher to pursue professional 

tasks because of -the efficiency ind effectiveness of the system. For the 

i ' 

LAT member, the ultimate test of the motivational quality of a process or 
management, system wouid be, of course, in the usage of that process or 
system. A high rating under the opportunity construcfc;would seem to guar- 
antee a high rating under XIA1, saving time and effort for the teacher. 

* t * 

Yet, this may not be so. While a system or process may cleat ly provide 
more time for learning, the analyst may feel that the teachers in this % : * 
school would not consider it a saving of time and effort that would be 
motivating to them for a variety of reasons. They might have tri#d a 
systematic way of recording- progress for each student in the past and may' 
have found it burdensome in spite of its obvious efficiency when.^ully / 
operational. For the teachers who felt this^way, even though they tpight 



agree Chat it permitted more on task time for students and direct ins true- 
ticra by teachers , the practice or system might not seem to be a sufficient 
saving of time and effort to make it motivating to them. 

The second question under the motivators construct (IIA2) relates 
primarily to processes, although it is conceivable that an efficient man- 
agement system, in some affective* way , by keeping the teacher calm and 
concentrated on task, could lead to more effective teaching. A behaviofist 
process of 'reinforcement might lead to more effective teaching, for example 

u 

as might a process such as the Pennsylvania Department of Education's Com- 
prehensive Reading /language Arts Plan (PCRP) using four critical exper- 
iences: responding to literature; self-selected and sustained silent * 
reading; composing-oral and written; and studying language patterns. 

The* third question under motivators (IIA3) is on the motivational 
aspect of the amount of time the system or process provides for the stu- 
dent to do what is interesting to him or her., This, of course, means 
cognitive activity of interest, not non-academic iriterests. One example 
of gpLs might be the aforementioned Pennsylvania Reading/Language Arts 
program f s ^Lf selected and sustained silent reading feature, which has 
the potential for being motivating for all children if properly imple- 
mented. , In 'some Schools where reading already is the "thing to do," it 
might be judged immediately and without reservation as a program that is 
highly motivating to the student. 

IIBi The questions in this instrument designed to determine if the 
system or practice provides the student with more independence in man- 
aging his own learning are the following: 

t 
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1. To what extent' doesthe student have a chance to select hid 
own topic, reading, activity, etc.? 

2. To what extent does he have a chance^ to correct his own 



work, decide when he is ready to go on to a ne^ activity? 

3. Is the student allowed to work with his/her own friends, 
tutor or to be tutored or otherwise interact, cognitively, with peers? 

This portion of the instrument's items on motivators hinges on the 
known motivational effect of self-management . Questions l-*4 explore the 
'extent to which this motivational effect is permitted to oberate through 
selection of topic (unit, perhaps) > activity (which lesson)!; to correct 
his/her work; to judge mastery and subsequent activity; to plan his /her 
own time, or to decide with whom he or she will work. 

All of these items are relevant to either a management system or a 
practice or process. An example, among R&D outcomes for student planning 
of his/her own time is the Self Schedule System, which is an instructional 
management System designed to allow different children to work on struck ' 
tured and unstructured learning activities at the same time within a 
classroom. It helps students take increasing responsibility for planning 
and carrying out their own activities with minimal teacher direction. 

Systems or processes may not be designed 'so specifically for the 
purpose of promoting self-direction and yet may permit it. The key and 
important term in the above description, however, must be kept in mind in 
evaluating all self-directional activities, Aether self-scheduling, self^ 
selection or self-evaluation: "increasing." The analyst should observe 

h 

whether the system throws, the child in to sink or swim, requiring him/her 
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to demonstrate self -management behavior Immediately, or whether the system 
teaches self -management behavior by permitting increasing amounts of It, 
with full Instruction In how to, do It. In the latter case of successive 

approximations, a process or system should be highly rated, but not in 

% ' - 

the former instance, because no practice could be judged motivating if it 

were threatening, and any "sink or swim" procedure would be a threatening 

one . . 

The Construct, Structure 

This construct, used to assemble analysis Information for systems 
or practices, is closely related to the just-discussed self -management 
dimension under motivators because the latter, as we have indicated, can- 
not be adjudged motivating* if it is not taught in steps* The focus under, 
the structure construct is hew well sequenced and appropriately spaced are 

s 

the steps, not only of self -management but of any other behavior which is 
managed or which is the objective the process. 
II IA. Questions asked are: 

1. To what degree do the objectives match the identified - 
problems in the ^target school? 

2. To what degree are adequate instruction and/or explicit 
directions provided for user of the system, process? 

3. To what degree do the demands of the objectives match the 
capabilities of the students and teachers and the constraints of their 
environment? < 

The first question is an evaluation of the relevance of the objec-. 
tives to the identified needs of the school, as thej^^objectives are 
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expressed in a management plan, scope and sequence of behaviors chart, or 



j 

s 



process objectives listing. The fit between the identified needs of the 
school and the objectives, individually, is a prerequisite consideration 
to the appropriateness of the entire structure of the process or system. 

Analysis of structure is considerably less complex for a system or 
process than for a product, since. a preduct is multi-dlmenfeional, .while a 
system or process is. essentially r syaonymous with a structured sequence 
of procedures. Therefore the major questions become a) the match of the 
objectives to the school v s problems, and to the capabilities of students 

and teachers, as well as to the constraints of their environment, and ' 

~ % ■ • ■ ■ 

b) the care with which the structure is maintained by adequate instruc- 

tions to users. 

extreme example of a non-productive management system for a given 
-achooJ would be one which required use of a computer when a computer * could 



aofe p*sS$ly be^made available to" that schoql. That would be an environ- 
menriarf constraint. Clearly such a system would not reach the point of 



ana 
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Is because it would be screened out* A. less obvious example, that 
d * reach the point of analysis, would be a management system that de- 



manded a specified weekly planning period, whicft a given school^might not 
be able to provide within the constraints of its scheduling 'and personnel 
limitations. * 

# <$, further example might be a process such as Self-S^hedul^ng. This 
system might be given a very poor quality rating by some LAT members who 
were searching for a procedure which would relieve them' of excessively de- 
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mending management duties (as Self -Scheduling would do) , but "who would 
- consider themselves incapable of yielding authority to students to decide 
when they will do whicfh" task. 

Particularly in reading, grouping often is a concern of teachers* 
A management system that provides for grouping and regrouping of students 
for reading and whiph prescribes recordkeeping and decision making pro- 
cedures for such grouping might well be a proposed adoption. 

Quite clearly, a grouping system and a self-scheduling system would 
be incompatible, but one group of teachers might prefer the former and 
another group, the latter. If this kind of difference could not be worked 
out during previewing, it might possibly result in more than one selection 
rather than a single choice. 

« 

The Construct, Instruction al Eve nts ♦ , 

_ : ~« ; 1 • ^ . 

This construct in the management systems, processes or practices in- 

r 

strument is a measure of the degree to % which the system or* practice permits 
* the teacher to be more effective. The major question is the following: 
Does this system or practice permit the teacher more time to piran and , 
-cprry out carefully selected instructional strategies appropriate for 
these students? 

IVA. The means by . which this could be provided is described in the 
three analysis questions: 

1. To what extent does the system relieve the teacher -of 
management, clerical duties. ~ . 

2. 4 To what extent does the' system itself incorporate use of 
effective instructional strategies? 
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3. To what extent does the system permit and encourage ere- 
ative teaching (beyond what is prescribed) by suggestion, example , in-* 
struction, etc*? • , 

While similar to the question on direct instruction (under oppor- *. 
tunity).* and, the motivator, saving of teacher time and/or effort, the 
focus here is 1 the quality of the instructional events the process or 
system makes possible. If it is a system,, it may relieve the teacher of 
management duties so that he or she, indirectly, is permitted to arrange 
more effective instructional strategies. If it is a process, it may in- 
corporate effective strategies. An example of this would be ECRI, which 
' is a process for teaching reading that incorporates a host of effective * 
^insj^jy^ctional strategies. 

Most processes are highly prescriptive (as are management systems) 
and they may prescribe effective strategies for the very situations which 
the needs assessment phase of the PSIP process has identified as situations 
which fequire attention. Question 3, however, goes beyond the actual 
'focus of the process or system being analyzed, to the degree to which it 
permits or encourages creative teaching. 

"* Zxamples of this would' be management systems which provide sugges- 
tions, examples, and how^to-do-it instructions for use of a variety of 
research-based* instructional strategies appropriate for gfsramrtticipated 
qt unanticipated situations. How to handle behavior problems through be- 
havior modification procedures, for example, could be a sugges ted *s trategy . 
How to provide the student with advance organizers on which following learn- 
ing could be built (or, in Ausubel f s terms', under which it would be sub- 
sumed) , woul£ be another example of instruction in effective strategies. 
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In short, the quality ratings the analyst gives to the dimensions 
analyzed under instructional events are Based on the degree to which the 
system, process or practice frees the teacher to teach while supporting 
the effectiveness of* that teaching by incorporating within it effective 
strategies, or encouraging and teaching the teacher to Incorporate such 
strategies in the process of instruction. 

Summary of Criteria for MPP Form 

Criterion for evaluating the quality of a management system is pri- 

. * 

mardly the degree to which it provides strong support for the teacher. 
This is true, also, of most processes. They are designed to provide system- 
atic assistance to the teacher in carrying out effective ^instruction. 

Fqr the construct, opportunity, freeing up of student and teacher 
for more on task time and direct instruction is sought. Self -management 
for students a?id saving of time and effort for teachers, as well as aid in 

teaching ftore effectively, are the goals for the 4 motivrffcors construct. 

/ . i 

The match of system or process objectives to needs and capabilities 
of students and' teachers and the provision of user directions and instruc- 
tions are criteria for the structure construct. ^« 

Instructional events quality hinges on both appropriate instructional 

strategies which are a part of the system and the provision of suggestions, 

• \ ***** 

examples, or instruction for the teacher in how to u£e other instructional 

strategies that can be expected to work* Relief frbm non teaching' duties, 

which a system or process might provide, is also a criterion for quality 

of instructional events, since it can give' the teacher time to plan in- 

» 

struct ion in advance. 
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Analysis of Che Curriculum Model or the Instructional Management Process 
The identification of the curriculum model or of the essential ele- 9 
ments of the instructional management process usually is a spin-off of an 
intrinsic analysis* By examining each important dimension of a curriculum 
in depth, the critical elements of that curriculum inevitably are high- 
lighted. Therefore, the model instrument is not meant to be used indepen- 
dently of either of the two analysis instruments. It does not serve to 
identify the curriculum model or the essential elements of the instruction- 
al management process. It does serve to suggest important . questions which 
must be attended if a product or process is to be adopted, in order to 
facilitate its effective implementation. The Initial assumption is that 
the analyst knows, or thinks he knows, what the model is. If s/he does 
not know, 'the questions should reveal the fact and further research on 
product or process will be required* 

I. The first question in this instrument refers to the critical 
elements of the model. Often „ the developer attempts to explain to the 
consumer the rationale behind the program he has developed. Sometimes, 
the research support for the design elements is explicitly cited. Usually, 
a developer who writes a documented rationale will provide, also f *a very 
clear description of those elements of the model which are vital to its 
effectiveness* If this is available, it is one source of data for the 
analyst f s response to this question. The information gained from carrying 
out an intrinsic analysis on the product or process is the other sourde. 
During the intrinsic analysis process f the analyst has been making 

notes on any critical elements of thft product or -process which are 

■ 
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revealed as he or she carried out each analysis procedure. The preface of 
this manual alerts the analyst to the need to make, notes on these elements 
as they become apparent. 

Since the dimensions which are emphasized in each product or process 
may be different, it is Impossible to suggest what to look at or where to 
find it in order to identify the model. However, there are a limited num-' 
her of dimensions that can differ from model to model and these intrinsic 

r 

analysis procedures, by organizing information under four major constructs 
help to systematize the information on the product or process so that the 
model stands out quite clearly. 

At the end of the analysis process, the notes that have been kept 
on critical elements should be reviewed and revised, if necessary, as a 
result of the overall impression of the model that remains after examining 
all the available artifacts. This results in a listing of critical ele- 
ments. Such a revision and refinement is a feature of this curriculum 
model or Instructional management process instrument. It is designed to 
lead the analyst to an explicit statement of his or her own, supported 
findings on the model. 

The reason the critical elements of the model should be listed in 
detail, is to recall them to the mind of the individual analyst and to 
make them readily available to debate with other members of the LAT if 
there is disagreement on what is critical. It is better to resolve the 
question of critical elements at the time of selection rather than to have 
serious* disagreement and, perhaps, less than optimal implementation la^er. 
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By critical elements, we mean the features of an innovation which 
make it work. There Is substantial evidence that programs often are what 
they say they are in name only because what is essential to the innovation 
has never been implemented or has dropped out in the course of being ad-| 
apted the local site. Usually, this is not purposeful, but happens 
because the adapters have lost sight of the critical elements of the model 
they have chosen. 

A typical example of this may be drawn from the early days of In- 
dividually Prescribed Instruction (IPI), which permitted students to move 
through the materials at their own .pace. A critical element was diagnosis 
on the basis of pretests. It was found some teachers pretested and then, 
even if the student mastered thq pretest , they made him/her do the lesson 
anyway instead of going on to the next lessoh. ' When challenged on this, 
in almost every instance the teacher expounded the philosophy: "Practice 
makes perfect. 11 They were undermining the curriculum they had adopted by 
ignoring a critical element of the model. * | 

On the other hand, sometimes teachers who have not recognized what 
is critical have been apologetic -to the developers because of changes they 
have made during adaptation, which have been non-essential features of the * 
curriculum and entirely acceptable. * An example of this would be the addi- 
tion of different books in any selected reading portion of a curriculum 
in order to permit a more interesting choice of books to the particular 
students* in this school. As long as the books were at the same reading 
level as tyiose they were substituted for, it wotild not affect the program. 
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XI. The second question is an attempt to support the itemized crit- 
ical elements generated in response to Question 1. Acceptable as evidence 

f. 

that particular elements are critical would be any statements of the dev- 
eloper in support of them, either with research or empirical evidence, or 
the logic of the developer's rationale. 

For example, for the self-schedule system mentioned previously, in 
addition to the specific objectives of the program which detail outcomes 
in terms of what the child will be able to do,' there are also listed goals 
of the system, the design of the system and student and teacher functions. 
From this wealth of explicit information on the purposes of the system it 
is possible to^deduce what elements are essential and what elements are •• 
desirable but not critical tO t the successful operation of self -scheduling*.- 

This does not mean that the process of identifying critical elements 
and listing the evidence that they are critical is a process of eliminating 
as many elements as possible which the developer has specified as important , 
in order to have a manageable description of the product or process that 
will merit the designation, model. ' % 

It me&ns, rather, subsuming or incorporating as many elenents as 
possible that have conanon characteristics under one superordinate -category 

in order to identify a minimal number of categories which can be designated 

V 

elements of the model. A model is f by definition, a representation or 

9 \ 

pattern of something. 

Curriculum products or processes never can b£ nor should be iden- 
tical in every setting, nor even In every classroom within & given setting. 
However, to attain the results attributed to a given prpduct or process, 

* ' ft 

key features (the model) must be, retained. It is these features that may 
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or may not be made explicit by the developer or publisher in the materials 

themselves, and it is these features that (must be identified and, partic- 

I 

ularly if they are implicit rather than explicit, must be supported with 
evidence of their essentiality. 

When the response to Question 2 is written, the analyst may want 
to revise the response to Question 1. 

III. To respond to Question III (UhafL. evidence is there that these 
elements are critical?), it may be necessary for the analyst to review the 
teacher 1 s manual. The listing of the various metKods of conveying to the 
teacher what elements are critical may seegi_isinecessary , but, as with all 
of these items, it is designed to lead towards greater and greater pre- 
cision in specifying and supporting the essentiality of the critical ele- 
ments of the model.' - 

Teacher materials may never describe 4 the total model in any one 
place. Each essential element may be introduced and explained as it id 
encountered. What to look for to find how the developer informs the teach- 
er about each element is a prescriptive statement (e.g., fr be sure to do 
the following," '"[always. ," "in sucfr a case, remember to...").. 

Sometimes th^ prescriptive statements are made to the student (e.g., 
"when you correct your test;* if this... then this...")* They will have to 
be translated £ntp something like the following: Self-evaluation and sub- 
sequent prescription based on it' are essential elements of the curriculum. 
This means that if the teacher refuses to permit students to evaluate 
their own tests and make their own prescriptions, the curriculum will not 
achieve the goals £o which it aspires- 
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IV. The fourth question in this instrument (Is further in-service 
instruction necessary or advisable?), is based on the previous three, in 
part. That is, if the model is clear, the response might well be that in- 
service instruction is not necessary. If it is still fuziy or if the crit- 
ical elements identified seem to be in conflict wit!h the philosophy or 
customary professional style of one or more teachers who will be imple- 
menting it, it may be wise to consider in-service instruction to bolster 
* the support for the model prior to attempting implementation. 

V. Either linker or LAT member will know, better than any external 

a 

analyst, those who must implement any selection. The fifth question seeks 
to build on this knowledge by requesting recommendations for experiences 
which would impress upon teachers the critical nature of these elements 
of the podel. For some teachers^ citations and explanations of research- 
in support of these elements, either in writing or delivered by an expert 
in a workshop situation, would be most convincing. For other teachers, 
simulations of actual classroom situations to demonstrate the effect of 
not attending to these elements might be more persuasive. Again, there 
might be teachers who wcfuld prefer to hear narratives of cases in which 
the critical elements wens violated — with results and cases in which they 
were carefully attended — also with results. This kind of information might 
not be available, however, in wt^ich case hypothetical cases could be used 
with probable results; 

VI. The fi#al question n^ed not be answered by either linker or 
LAT member. It is listed as a reminder to linker, LAT, and SAT that all 
of the agencies involved in PSIP have a responsibility to be sure that no 
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outcome should fail to be effective because the school did not know, clearly*, 
the model it had chosen in advance of installation. -The question is: "How 
can the facilitator (PSIP) provide these experiences?" All of the agencies 
must keep lines of communication open so that if any outcome model has 
not been clearly and accurately defined by and/or for the adopting site, 
in such a way that the critical elements will ; not be violatjed, experiences 
will be provided by PSIP to help pinpoint those critical elements. 

To demonstrate the process of taking notes whenever a critical ele- 
ment of the model surfaces «s one analyzes a product ot process* part of 
the description of the Self-Schedule System from the NIE Product Catalogue 
follows. As described previously, this system supplies a substantial 
amount of descriptive material and lists goals and objectives for each 
component and each participant role in the program. However, the quota- 
tion below tfill suffice to demonstrate how key words can alert the analyst 

to critical elements of a curriculum or a system. 

# 

"Under the Self-Schedule System , children pick up their prescribed 
assignments at the beginning of each activity session (either a 1 day or 
a H day) and understand that they must Accomplish the prescribed tasks 
during the course of the session. They may, however, work on «the tasks 
in any order they choose. Under this system, at any given time children 
can be found working in virtually every area of the classroom, with the 
teacher circulating among them. Small groups of children can be called 
together for group activities - for example, a group reading lesson - 
whenever the teacher wishes. Children can also form groups of their own 
for exploratory games or other activities. When the group session is 
over, children can return easily to their previously interrupted activi- 
ties or to new ones. 

The teacher's role involves guiding and providing proper environ- 
mental support for the student. These functions are critical to the 
successful operation of the system. The "how to" aspects of carrying out 
the teacher role are provided in a detailed teacher's manual." 
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r With key words underlined, th£ notes the analyst would make after 

reading this paragraph probably would look something like this: 

i . 

System Model.- possible critical elements - first listing : r 
Student: 

Prescribed assignments. 

( must accomplish during session) ' ; 

2. Choose task order. 

3. Can form groups. ^ 
Teacher: 

1. Role involves guiding and providing proper 
environmental support for student, 
( critical functions) ^ 

2. May group whenever (s)he wishes. 

Note that the key words fall into two major groups. The most im- 
port ant group designates invariant tasks, roles, rules, etc. These are 
such words as prescribed and must. The second group involves ^allowed 
variations. These are such words as choose, can,, may. Qualifying words 
are also helpful because they may specify! how important elements are such 
as "critical" as applied to teacher functions in the above paragraph. 
Another such word is "whenever" in the above paragraph specifying that 

* 1 

there is no limitation on teacher's option to form groups. 

The analyst inevitably will have a very long first list of iden- 
tified elements in his or her first few attempts at analysis. However, 
after discussion with other members of the program analysis or selection 
team, the list can be very quickly curtailed as the elements that are in 
the same class are combined into a single category of critical elements. 
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The process of defining the model is a very important learning ex- •' 
perience and one that the author of this manual feels confident is crucial 
to successful adoption/adaptation -and to both effective and enduring inf- 
pletnentatlon of Innovative products or processes. 

' Conclusion , * 

Four constructs which incorporate dimensions that seem to make a 

■ 1 

difference in (student achievement have been used^to^prganize questions for 
intrinsic analysis of curriculum products or fi^Qftesses. These questions 
examine the quality of the dimensions under each construct: opportunity, 
motivators, structure and instructional events* In addition, the process 
of performing theanalysis provides an opportunity to identify critical ' 
elements of the, product or process being analyzed. 

The instruction in procedures for performing an intrinsic analysis ^ 
using these instruments is the substance of this manual. This instruction 
consists of explanations, e samples and step-by-step procedures, with 
supporting research references in the appendix. ^ 

There are several component skills required to carry out the neces- 
sary analysis procedures. Some of these skills are quite specialized and 
the description of procedures may not give the novice analyst the confi- 
dence to apply them/ They should be rehearsed in a hypothetical situation 
before they are applied on -the analysis of a curriqulum product or process 
Therefore, a series of practice exercises are provided on the following 
pages. An answer key follows the exercises .with suggested appropriate 
responses* 
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Exercises 

Much of the knowledge and many of the skills required for performing 
an intrinsic analysis normally are part of the teacher's repertoire and 
beyond the scope of this manual. What is more, teachers use this know- 
ledge and these skills daily in making decisions about teaching activities. 
However, they seldom analyze their present materials or select new mater- 
ials in any systematic way. 

Intrinsic analysis instruments and procedures, as supplied by this 
manual, are necessary to provide a framework for the systematic examina- 
tion of materials to make present materials review and new materials se- 
lection more rational processes. 

Among the analysis skills which teachers may be expected to have 

are the ability to Judge the appropriateness of materials for their stu- 

> " 

dent populations* and to recognize adaptlveness to individual differences, 
variety of activities and format and provision for self -management. 
Teachers- can be expected to recognize adequacy of teacher support in 
manuals and student materials and efficiency of the management system. 
To use these skills, then, the rationales, descriptions, examples, in- 

s 

struments and step-by-step procedures are sufficient assistance. 

There are, however, a few skills involved in performing a corapre- 
s • - . , 1 

hensive intrinsic analysis which not all teachers will have acquired. 'fc The 

exercises which follow are designed to provide a self-check on skills in 

performing these less familiar procedures. The answer key at the end of 

the exercises makes it possible for the analyst to spot any of* his or her 

problem areas . 

S'2 
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Qpie way thes£ exercises can be used is for helping program analysis 
ojr selection te^w members to identify the role they will take in the actual 

4 

analysia process after completion of the training manual* Tasks may* be 
assigned in such a way that each task is performed by at least two people, 
one of whom is confident in his or her ability to carry out all of the 
required procedure^. This teaming of analysts will give the less con- 

fident team member th&'feer support needed to acquire those skills in 

\\- 

which 4ie or she is weak* through supervised practice. 

• 4 

These exercises are without directions in order to simulate tt^e real 



analys^^sij>uation when the analyst is confronted with the materials 
of Va program and must judge them along the dimensions taught in this man- 
ual. Each of therffe selections* is chosen tyecause it "represents an example 
of instruction or instructional directions which haye been characterized 
"previously in the manual. You i&ay prefer to check your response to the 
first item In the answer key that follows on page 84. 

1. Teacher manual information: $ 

Teacher* often l^pok thfbugh* the text for remedies to problems. * 
However, if the teaching is a system, then* it is impossible to skip 
about and have the system work. # .While the order of presentation hereof 
is not the only possible order, if is not possible to introduce- another 
order without rewriting the series. 

Therefore, the teacher must use the lessons in the order pre- 
sented. You may go back to reteachj but , you may ,not go forward, skip- 
ping steps -between. You may add things, only ff absolutely necessary 
and then, Qnly with great caution, because it is d£fficult r to unlearn ^ 
incqrrect generalizations. (Paraphrased from The Roberts English Series , 
NY: Harcourt, Brace, World, % 1966) . - 

I 

2. The reading program, in its rationale describes ,Its academic 

games that children enjoy, some similar to scrabble and that are 

* — * 
ball gam^S for teaching spelling and arithmetic. Then it recommends that 



77 



9 

ERIC 



the children be allowed to play them to develop their interest so they , 
will find the more traditional arithmetic and spelling driLl that follows 
less distasteful. ^ * 

^3. |The students are learning to do long division. The strategy is 
to teach them by giving them a long division problem solved with only the 
last step, the remainder, .to be found. Then the student does the last two 

steps, the last three steps, etc. in consecutive order. ' The problem is 

* ■ * 

presented to the student correctly solved up to the stepS" left for the 

4 

student to do. 

4. Directions to the teacher: 

i^ave the children clap once as you say, fast , twice as you say 
faster . Then pronounce each word carefully so both syllables can be heard, 
(farm, farmer; start, started) as the children clap have them decide 
vhether it is a one 'or two syllable word: 

darapCT hunter pepper 
dump hunted * into 

mend dart hand 

Have the children write h on the chalkboard. Have the children 
repeat after you. * ^ 

hot hole * 

hat hem 
hate hitch 
bit -happy 
' high Ixoney 

Have children give rhyming words beginning with h, explaining that 
rhymes are words that sound alike except at the beginning like Jill and 
hill, sled and bed. 

Teacher says word - child says rhyming word: 

top (hop) rope (hope) 4 

fy % sit (hit) com (horn) 

fat (hat) mail (hail) 

fold (hold) " roam (home) t t 

(Paraphrased from Basic, Reading , NY: Lippincott, 1963) 
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3.4 

AT CAT 
AT - RA_ 
AT - H - 

Teacher: Ask tne student to complete columns 2, 3 and 4. Explain s/he 
mu^t follow the dots in column 2, fill in the first letters in column 3, . 
follow dots and fill in blanks in jolumn 4. 

6. Rationale: > 

At the early levels of "this program,' illustrations are used for an 
additional context for the printed messages. The children learn to use 
pictures to verify the predictions they make from the print. As children 
move through the* levels, the picture to, print ratio diminishes. 

7. Composition - Grade 3: n 

\. Keep the lesson entirely oral. A 

2. Write on the board the words familiar situation - getting ready for school , 

3. Use free discussion*, encouraging student to tellr what their sensory 
experiences are as they prepare' for school. What do they see, hear, 
feel, smell? 

♦ 

4. Do not write down ideas but "concentrate on receiving as many ideas as 
possible in 10 to 12 minutes^ \^ , ^ 

(Teacher directions continue with exercises involving just sight, then other 

senses one at a time in subsequent lessons, JFinally, have , the students write 

single words with modifiers on some given familiar situation.) ' 

< 8. Studenft directions: • 

V 

1. Below are four pairs of statements. Read them. 

a. Clouds are formations of condensed water. 
Clouds are like ptuffs of cotton. 
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b. The United States is committed to* giving' military assistance to > 
many countries. 

The United States is a fortress guarding against the assaults of 
tyranny. 

c. A song consists of words which are recited in rhythmic patterns Co 
the accompaniment of music. * 
A song is like an angel T s sigh. 

d. A dog is a four footed , domesticated, carnivorous mammal. 
A dog is man's best friend. 

2.. Now, choose one pair of sentences and write two brief paragraphs 

beginning each with one of the sentences in the pair you have chosen I 
Then, compare the two paragraphs you have written and, answer this* 
" question: How did the point 6f view taken in the first sentence of ^ 
each paragraph determine wlpt you could add? (Paraphrased from 
Postman: Exploring Your Language , Holt, Rinehart and Winston, ^Y, 
1966.) 

9. From the teacher's manual:. 

Discrete examples of concepts differ widely in nonessential features* 
such as shape, size and color (if these are nonessential). 
10. Rationale: 

\ The authors of this program believe that the basic facts taught in 

■\ * - - * * *\ . ■ 

second grade should be presented by the same direct method, not indirectly, 

\ • V 

and thkt, the goal should be to know them to the point of immediate recall. 

Student materials: 
If 4 + 6 - 10 and 1 more than 4-5 

then 5+6-1 more than 10 or 11. -I * 

* 11. The student worksheet shows three columns of pictures of different 
\ sizes and shapes of different colored containers labeled pints or quarts. 
The directions tell *the teacher to ask the students to decide whether the 
pictures in each row hold an amount equfl to, less than or greater than 
the "amount .the top row of containers ho Id* and then draw a ring around' the 
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correct gA>up of words (equal to, less than, or greater than) written at 
the side of each ^w. ' '* 



12. The foJLlowing is a portion of. the objectives of a math curriculum 
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for early elementary >§chool children: 
* 

The student should be able to: 

read a list of telephone numbers 
tell his/her o home phone number 

dial a telephone number . x 
read a calendar 

circle the day's date on the calendar 
write the day, month and year 
read a thermometer 4 
write the temperature of the room 
using play money, count it 

simulating purchases, pay and 

count change. 

(and others in the same vein) ^ 

13. For kindergarten children, teacfier directions: 

* * - 

Have the children follow two step directions, such as "Get up from 

0 

your seat and close the door (or .open the door)." After the students have 
mastered this, follow it with three-step directions. "Get a piece of red 
paper, get a pair of scissors and cut the paper in half." Some kinder- % 
gar ten children can go on to follow four step directions after mastery of / 
three. ^ 

14. Teacher directions^ 

GUIDANCE CHART FOR LETTER SOUNDS 
YOU WILL LEARN TO READ A NEW SOUND. 

THE NAME OF THIS LETTER IS... (Pupil Response) .; 
WHAT IS THE NAME OF THIS LETTER? 

THIS LETTER MAKES THE SOUND/ /* - 

SAY / /. 

WHAT SOUND- DOES THIS LETTER MAKE? 

* ' ' 87 
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SPELL AND READ THIS SOUND. 
(Remove model) WRITE, SPELL, AND READ. 
(Show rn^del) PROOF AND CORRECT. . . 
WHAT LETTER MAKES THE SOUND / /? " 

(Remove model) SPELL AND SAY. *LOOR AT ME (Delete "LOOK AT ME" wheri 
behavior Is established.) 

NOW, LET'S PUT THIS CARD WITH OTHER CARDS, OF THE SOUNDS WE KNOW AND 
PRACTICE THEM. , 

Practices with f las hear ds ■ , } ' 

READ THE SOUND OF THE LETTER WHEN MY FINGER TOUCHES THE CARD. 

READ THE SOUND AS MANY TIMES AS YOU CAN UNTIL MY FINGER COMES OFF THE CARD.* 1 

I WILL PUT THE LETTER "J % WITH OTHER LETTERS YOU HAVE LEARNED. READ ONLY 

THE SOUND / / WHEN YOU SEE THE LETTER " ". (Use only when limited 

number of letters have been learned.) 

READ THE SOUND OF EACH LETTER." 

READ 'THE SOUND OF EACH LETTER TIMES. 

READ THIS SOUND AND HOLD IT AS LONG AS MY FINGER IS Oft THE CARD. 

(For continuant consonants only.) ' 4 

^Practice in written exercises " 

WRITE, SPELL" AND READ ALOUD THE LETTER THAT MAKES THE SOUND. / / AS MANY 

TIMES AS YOU CAN UNTIL I SAY "FINISH." THEN FINISH THAT LETTER AND PUT 
YOUR PENCIL DOWN. "FINISH.-" . 

WITH, YOUR FINGER UNDER EACH LETTER^ READ THE SOUNDS OF THE LETTERS YOU 
WROTE. * . 

(From Exemplary Center for Reading Instruction, ECRI, Salt Lake City, Utah) 

15. Student' objectives: 
*. ' 

a. Identifies calendar units, // days in week', # days in each month. Com- 
pletes claendars. Word problems. Writes given date in words and 
numbers or in numbers. ' 

b. Reads any time on clock face using hour and minute hands* Shows any 
time using clock face. Writes and reads time using appropriate vocab- 
ulary and punctuation* s 

c. Finds minutes elapsed between 2 minute hand readings. Limit 2 hours. 
Calculates passage of time. 
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Solves prpblemS'adding/subtrActririgJhours/half hours on clock face. 

Adds/subtracts time units. One'stelp pi<©blems. No regrouping. Limit 
2 H hours. v '.*"''." ' ' ■ . 

Solves problems in reading bus, train, plane schedules. 

Addition/ subtraction 2-3 time units. 1-2 regroupings. Seconds 
through years. 

« 

16. The following is a list of objectives, each of which is followed 

a test item for that objective: ! 

i , — 

The student should be able to comprehend and interpret the reading 
materials assigned to him/her. 
Test items: 

The short story, "Gift, of the Magi" is assigned to be read and the 

following questions to be answered: . i 

What was the relationship of the two principal characters?- 
.What Was the surprise ending? a ' 

Why did it happen? • 
* How do you think the man and woman felt about their gifts? 

The student should be able to select library books that are of interest 
to him. 

- . ; . . 

Test .item: 

Below is a list of fiction and non-fiction books at your reading 
•level that are available in the school libr.ary, plesse indicate • 
by. a check mark those you would find interesting and .write ope 
4 sentence for each book checked saying why you checked it.\ 
~* (List follows) ( w A ' ' 

The student should be able to define the follcrffing words: noun, 

♦ • * 

pronouq, adjective, adverb. 



Te$t item: t ; , 

*Below are foCir words and four definitions. Match the words to the 
definitions by drawing lines between them. ' ~ 

$ (There follow the four words in.one column and the mismatched y , 
* four definici^^in the otheO * / 
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d. The student should be able to find the area of a rectangle. 



Test item: 

The table is 5 feet long and 4 feet wide, 
area of the table? 



What is the 



) 
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Answer Key to Exercises 
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1. This indicates that sequence is a critical element of the model. 
This is a linguistics program and these two paragraphs are clear j evidence 
that sequence must not be changed. Note the imperatives "must," "may not," 
"only" which show that the only possible sequence adaptation is to reteach 

when necessary. Even supplementation is discouraged. 

» > 

2/ Tfiis appears to be an attempt to'use games. to motivate. However, it 
is an inappropriate, instructional strategy < instructional event) because 
the orddr should .he reverse^. The behavior ist Pretnack principle suggests * 
thit higher probability behavior will reinforce lower probability behavior. 
Therefore .the dril¥ should precede the games tfith the latter promised as 
a reinforcement of the lower probability behaviors^ 

3. This Is an appropriately used instructional strategy (instructional 
event). It* is. an example of backward chaining which* reinforces the student 
with a correct answer as he "proceeds. It Is also ah example of successive 
approximations since each step is an approximation of the desired terminal 
t behavior of solving a long division problem. 

4; This an example of direct instruction. The students are kept on 
tasfc by theit active patticipation, clapping, repeating aloud and con- 
' tributing rhyming words. * y 

5. This is an example of the use^ of cues (the. pictures and the dotted 
lir^es) . It is also a small step procedure*. Both strategies are used 
correctly. . * ** 

6i The strategy described -here, is fading. The pictures are cues which 
are gradually faded as the- instruction progresses. T^ji^ has implications 
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fo'r the instructional model, also. It happens to be a learning experience 
program and the pictures are a part of the means by whict children are 
enabled to experience language quickly through context. ' 



The pictures, 



therefore; are a critical element of the instructional mctfel and varying 

tJhe order" might undermine the strategy. 
\ - 1 

7. This is use of successive approximations. It is carefully structured 

in small steps. It is motivating because it appeals to- students' personal 

'i .1 

experiences. It is concentrated intense treatment. (Note khe caution ;vi ^ 
"Do not write down ideas." This would cause delay and the possibility of 

inattention.) v ' e 

: , • • • . _\ 

8. This is an excellent example of the discovery method. The student 

discovers for himself or herself how significant the tone of .a\ topic 
sentence can be. It is extremely well designed. 

9. Appropriate concept teaching strategy to help the- student discover the 
critical attributes 3f the concept^.* 

10. If this example actually had appeared in materials which claimed the 
philosophy expressed, they would be thoroughly inconsistent. The theory 
supports memorization of the number combinations. 

Tljgs is^ very intense treatment. The students have to convert pints 
.to quarts, read the words and demonstrate understanding of the concepts 
greater than, less than and equal to. . For appropriate structuring, this 
lesson would have required the mastery of prior objectives for the con- 
cepts pint»and quart and prior objectives for the concepts greater than, 
equal to and less than.' The analyst should ascertain that these concepts 
were taught. If they had been taught, it would be a good lesson. , 
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12. This would be a good example of the functional use of number]? 

r 

(motivators), 

13. this is a small steps strategy $ftd the last sentence indicates an 
attempt to individualize instruction on the basis of diagnosis of \sach 

student v s development • 

« /■ 

14. This is very direct instruction. It is teacher guided. The s^uden^ 
are kept strictly on task. In addition, it employs a strategy of us 
all the senses /*Tl^^howing of the model for proofing and correcting 
provides immediate feedback. The exercise includes timed practice. 

4 procedure of watching the teacher is a modeling strategy which also is 
prompt that is faded when the behavior isfestablished. All the strategi 
employed are used appropriately, 

0. 15. This sequence on time has two major gaps in it. There is no pro-^ 

■ * 

vision for learning morning, afternoon, might and ,for dividing the day 
9t noon and midnight and learning to write A.M. and P.M. 
There is no provision for identifying the" second hand, reading, seconds 
and learning how many seconds there; are in a minute'. 

16. a. The test items for this objective are appropriate . : The literal 

« 

questions test the comprehension part of the ob j ectlve- and the ^nterpretiVe * 
questions test the interpretive part of the objective. It does not re- 
quire great skill to interpret this particular story, so the questions are 
simple and straightforward. 

b. This test item is inappropriate. The objective is to select. A 
selection process goes beyond reading & t^itle. It may be influenced by 
the table of contents, illustrations, 'the brief cover overview, etc. 
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The justification of the selection was not part of the objective and 
would be an unrealistic task on the basis of title alone. 

c To define means just that. It does not mean to recognize a 
definition. Also; 4n matching questions it is better not to have an 
equal number of items. 

d. This test item matches the objective. 
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Intrinsic Analysis instrument 
? - Parti ' - ' 

Student Materials, Inservice Materials, Parent Materials (SIP form) 

Preparation and previewing of materials is the first step before analyzing 
* them along the following dimensions. , 

I % Opportunity (substanc^): 

A. Are the' activities, content and concepts appropriate for the 
student' population so there is opportunity to leant? 

1. Are the activities appropriate for the developmental level 
„ and socio-economic characteristics of the students? 

4 ' * 

/ , 

2. Is the content relevant to these students? 

3. Are the concept examples provided relevant to the student 9 s 

* * - ' / 

/ experience, needs, stage of instruction, so copceptualiza- 

/ * 

tion can occur? ^ / 

/ . . . . . 

Quality rating of activities on the basis of AI % 2, 3,: 

* f ' r ^ i 

. ' • / 1 

(1. excellent; £ good;' 2 fair-; £ poor) " , ■ 

Opportunity (usage) 

B. Do the materials ^each ,in a clear, focused, concentrated way and 
adapt to individual learning differences? 

1. Do the materials supply concentrated cognitive activity fqr 

i, • • 

' the student "(parent , teacher) to assure adequate opportunity 
\ • ■ ; 

• to learn? % * • *P > . 

• ' L , V ; ■ 

2/ Do the materials provide the opportunLty^to learn for;both 
slow and fast students and do. they * provide for different 
learning styles? * 
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Quality rating of intensity of treatment andt adapt ivenes s 



^ ' .'..»"'"" on 1 ' the, basis of Bl, 2. 



r 0 « 

(1, excellent; 2. good; 3. fair; A poor) 

II- Motivators: 

A. Is there an opportunity for student (parent, teacher) 
self -direction, selection, evaluation? 

1. Does the Student (parent, teacher) 
? - select instructional activities? 

2. " Does he or she plan his/her program? 

3 . Does he/she have an opportunity for self- 
evaluation? 

^Quality rating of motivators on the' basis of Al,2 r 3 



- (1 excellent; 2 good fair; 4 poor 1 ) , • 

B. Do the materials provide reinforcement or do they 
instruct the teacher how and when to do so? 

1. Do the materials provide reinforcement? 

2. Do the materials provide feedback? 

*- <_ 

Quality, of reinforcement based on Bl, 2." . 

(1 excellent;'^ good; 3 fair; 4 poor) . . 

C. Is there sufficient variety in the materials to appeal to 
student interests? % 

C v 

1. Is there r variety in methptf, mode* format f and in- 

* '* < 
structional strategies? >/ 



2. .Are there alternative paths, through the materials 

.'.,».• ft -T - . 

to accommodate individual differenced? t - - 
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3. Is content appealing to a range of Interests? 

4. Are materials functional, related to life 
experiences? 

• . Quality of variety on the bases of C 1-4 _____ 
0 (1 excellent; 2 good; 3. fair; 4. PP? r . 

4 ■ 

III. Structure: . * 

«% ( 

A. Are there specific expressed instructional objectives or 

clearly Implied objectives on which the instruction is based? 

*** 

1. To what degree does the instruction teach to 
the objectives? 

Quality rating of objectives ion the basis of A 1, , 
' (JL excellent; 2 good; _3 fair; _4 poor) 

B. How well are the objectives structured and sequenced to 
build towards the terminal goals ♦ t> 

1. as indicated by a concept analysis? (sampling) 

# 

2. as indicated by a content analysis? (sampling) 
*3. as indicated by a skill analysis? (sampling) 

Quality rating of sequencing on the bas£s of B 1, 2, 3 

(j_ excellent; 2 good; 2 fair; ^ poor) 

C. Is there a .testing procedure adequate to determine mastery of the 
objectives. 

1. How well do the test items, observation guidelines or 
other mastery criteria match the implied or explicit 
objectives? . - • 
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2- Are all objectives, stated or Implied, measured or 
checked by observation and are criteria provided? 
a. Affective? ' * 

• b. Cognitive? 

i 

c. Psychomotor? 

Quality rating of testing on the basis of C It 2: 

(1 excellent; 2 good; 3 fair; k pooir) 
D. Does the instructor's manual provide guidance for diagnosis 
and remedial -treatment ? 

1. How adequate are the» props which the instructor's 
manual provides to guide the teacher in diagnosis 
of student needs and for placement and progression? 

2. How adequate is the guidance supplied by the teacher's 

/ 

manual for alternate, remedial or supplemental 

" * - ' / 

st ruction for students? 

3. To what degree do the range of the objectives alfcne 
or the objectives combined with the remedial or 
supplemental instruction match the range ^of the 



, student -papula* ion? 
Quality rating of guidance for diagnoses and treatment 



/ 

on the basis of D 1, 2, 3, 



(1 excellent; 2_. good; 3_ fair; 4 poof). 
Instructional Events (Substance): 

■ / '. 

A. Does the teacher's manual (in-service/ oy parent 

V . i ' 

materials} furni«h sufficient teaching assistance' 

98 
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1. ' Information on methods? 

2. Information on strategies? 

3« Background information, vocabulary (definitions 

of terms) and procedures? 
Quality of teacher preps cm the basis of A 1, 2, 3, 

(1 excellent; 2 good; 3 fair; 4 poor) 



B. Is the quality of instruction in student materials con- 
sistently high? 



1. Content quality? 
• * 

2. Concept quality? 

3. Skill quality? 

Quality of teacher props on the basis of B 1, 2, 3, 
* {\ excellent; 2 good; 3 fair; 4 poor) 



C* Is the management system efficient enough to support the quality 
of instruction? 

r 

1. Can students work Steadily without delay or threat 

* t 

' 4 

to the effectiveness of instructional events? 

2. Can teachers manage instruction without frequent 

breakdowns in. the system? 
/ 

Quality of management system 9n the basis of C 1, 2, 



CI excellent; 2 good; 3 fair; 4 poor) 
Instructional Events (usage) 

\^ 

D - Are the instructional strategies and methods appropriate 
« * 

for this student population and are they used effectively? 
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1. Appropriateness*' of strategy 

selection and usage? 
2* Appropriateness of methods selection 

and usage ? 

Qualify of Instructional strategies and methods bashed 
(1 excellent; 2 good; 3 fair; 4 poor) 



I 
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■ Intrinsic Analysis Instrument 

0 

Part 2 

Management Systems, Practices or Processes (MP P form) 

I. Opportunity: 

A. Does this system or practice provide more time * 

for learning? 

1. To what extent do^s the system or practice 
give- the student more on ^ task time?. 

2. To what extent does the practice or system 
give the teacher more time to actively teach 
(direst instruction) or guide student learning? 

Quality rating of opportunity on the basis of 1, 2, 

• J- 

II. Motivators: | 

A. Does this system or practice offer advantages to both 
student and Peacher which will encourage cooperation 

t 

4 

in implementing It? 

1. To what extent does it save the teacher time 
and/or effort? 

2. To what extent does it help the teacher teach 
more effectively? 

3. To what extent does it help the student spend 

' more active time in learning what he/she fiads 

i 

interesting? 

Quality rating of motivators on the basis of 1, 2, 3 



B. Does this system or practice provide the student with 
*more independence in managing his own learning? 
1^ To, what extent does the student have a chance 

to select his own topic, reading, activity, etc.? 
' 2. To what extent does he .have a chance to correct his 
own work, decide when he is ready to go on to a new 
activity? • 

3. To what extent is he/she permitted, encouraged, 
••• • to plan his/her own time? 

4. Is the student allowed to work with his/her own 
friends, tutor or be tutored or otherwise inter- 
act, cognitively, with peers? 

Quality rating of motivators on the basis of 1, 2, 3, 4 

Structure: 

A. Are there specific process objectives (i.e., student self- 
management, learning-to-learn, maximal use of expertise by 
team teaching, etc.)? 

1. To what degree do the objectives match 

the^ identified problems* in the target school? « 

2. To what degree are adequate instruction and/or 
explicit directions provided for the user of th^ 
system, process? 

3. ^To what degree do the demands, of the objectives 
match the capabilities of the. students and teach- 
ers and the constraints of their environment? 

% Quality rating of structure on the basis of 1, 2, 3 - ib > 
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IV. Instructional Events: 

A. Does this system or practice permit the teacher more time 
to plan and carry out carefully selected instructional 
strategies appropriate for these students? 
1. To what extent does the system relieve the 
teacher of management y clerical duties? . 
^ 2. To what extent ^does the system itself incorporate 

use of effective instructional strategies? * 

V... 

3* To what extent does the system permit and encourage 
creative teaching (beyond what is prescribed) by 
suggestions, example, instruction, etc.? * v 

Quality rating of instructional events on the basis of 1, 2, 3 
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Intrinsic Analysis Instrument 
Part 3 

it 

Analysis of the Curriculum frodel or the Instructional Management Process 

I. What are the critical elements of this model?' 

(implicit or explicitly specified, by the developer) 

( 

II. What evidence is there that these elements are 
critical? 

e 

III. How do the teacher materials inf&rm the teacher 
of the essentiality of these specific model com- 
ponents? 

IV. Is further in-service instruction necessary or 
advisable? j 

V. What kind of experiences are likely to impress upon , 
the teacher the critical nature of these elements? 

VI. How can the facilitator (PSIP) provide these 
experiences? 9 



' f 
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Intrinsic Analysis Instrument - 
Long Form* 

Student Materials, .In service Materials, Parent Materials (SIP form) 
Preparation and previewing of materials is the first step before analyzing 
them along the following dimensions * 
l m Opportunity (substance): 

A* Are the activities, content and concepts appropriate for the 
student population so there is opportunity to learn? 
1. Are the activities appropriate* for the developmental level 
and socio-economic characteristics of the students? 

a. Are all written explanations and directions for students 
simple, uncomplicated, straightforward and easy for this 
age level to understand? 

b, Is the objective* o£ each ta^k assignment expressed clearly 

-> 

for the student to know explicitly what s/he must do, how 



) 



well? If it is not clearly expressed, is it vef y obvious 
from the wording what behavior is expected and the level 
of performance reqlxired? 
2r Is the content relevant to these students? . 

a. Does the content relate closely enough to the student's 
own knowledge and experiences to build on tljem? Does it 
offer enough new information to provide opportunity to 
learn that can be rel'ated to what is already known? 



1 



There is no long form tor the process part of the instrument (Part 2 , MRP 
form) or the curriculum model or instructional management process form 
(Part 3). 
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b. Is there -content (i.e., facts, information, events, people) 
„ thatj^ou deem essential, which is^left out? 

3. * Are the concept examples provided relevant to the student Y s 
experience, needs, stage of instruction, so conceptualization 
can occur? ' 

a. Is. there instructional material jj^ilable to teach essen- 
tial concepts, written in vocabulary at the level Of the 
lowest student? Has some of «the instruction been planned 
to challenge the most advanced student? * 
. • b. Are concept instances selected so -that early in instruction 

• ■ i 

• ♦ ■* 

they have few irrelevant .attributes '(or characteristics 

that are not the essential defining characteristics of 

\ ' ' ' , * 

*. ' that^ concept class) ? • - / 

Are concept instances, late in instruction selected which 

■ / i ■ 

have more irrelevant attributes, and hence are more dif- , 

f icult to recognize as examples of the concept? , 

** 

c. Are there concepts (i.e., classes of things that are the 
important organizing centers of a subject) which you con- 
sider essential that are left out? 

Quality rating of activities on the basis of Al, 2, 3,: 

O excellent; 2 good; 3_ fair; 4^ poor) 
Opportunity (usage) 



B. Do the materials teach .in a clear, focused, concentrated way and^ 
adapt to individual, learning differences? 



J ■ 
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1. Do the materials supply concentrated cognitive activity for 
the student (parent, teacher) to asstire adequate opportunity 
to learn? * H 

a. Ip there opportunity provided to learn each expressed 
or 'implied objective? 

b. Are there enough learning activities to maximize the 
„ ' students' opportunities for learning? * 

, c. Do the materials suggest or provide sufficient direction 

to make possible dirett instruction (i.e.; teacher-directed 
instruction) a large part of the time? 

2. Do the materials provide the opportunity tp learn for both 
slow and fast students and do they provide for different 
learning styles? 

a. Are the exercises and ttflfcs demanded of the student diverse 

■ enough so that , students f * different learning styles, tan be 

• # 

accommodated? 

b. Do 'the instructional materials supply - enough practice for 
these students to learn? . * - 

c. Does the management system suggested by the materials 

permit adaptation* to individual pace? . 

• * * * 

Quality rating of intensity of treatment and adaptiveness on the 

basis of Bl, 2: ' 

(j_ excellent; 2 good; 3 fair; _4 poor) 
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^ ' II. Motivators:" , ' * S '' «- 

• A. Is there an opportunltyj for student (parent, teacher) self- 
' direction, selection, evaluation? 

1. Does the student (parent, teacher) select instructional 
activities? 

a. Have the materials taught the student or provided guide- 
lines for the teacher to teach, the student how to make 
appropriate selections? 

b. Is there any variety in procedures for making selections 

to accommodate individual differences in self-d^rectedness, 
/ complementing the teaching and/or guidelines in la? 

2. Does he or phe plan his/her program? 

* a. Is the' student allowed to plan his/her own time without 

prior instruction in how to do so? How adequate are the 

directions for this independent kind of behavior? ■ 

* 3. Does he/she have an opportunity for self-evaluation? . 

^ a". Is there instruction in how to evaliiate*hi&/her- own work? 

b. Is the student eased into self-selection, self-evaluation 

in a step-by-step fashion appropriate .to the developmental 

• * and experiential level of the- student?* 

Quality rating of motivators on the basis;of Al, 2, 3,: *. 

* *• 

(_1 excellent; 2 good; 3 fair; 4^ poor)" 

B. Do the materials provide reinforcement or do they instruct the 
teacher how and when to do so? 
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Im Dq*the materials provide reinforcement? . ✓ 
a. Does the instructor's manual 4 provide examples of appro-' 

• % • . ' " " - ' . - ' 

'priate reinforcement procedures? 
tb,,. l>oes the student see the objectives' or are the^ check-.- 
f V lists or some ^recognition of progress that the student' 

* *. . .' • ,can use to monitor his or her success? * , / 
2.^06. the materials provide feedback? . , 

a. .Are, the .dirwlgi.ons to the teaoher for providing feedback 
^ arjd motivators sufficiently clear and are the signals in 

trffe g&terials for how and wt\en to use them sufficiently 
at;tentioprgetting to encourage their use? 

Quality of reinforcement based on Bl, 2; 

(_1 excellent; 2^ good ; _3 fair; 4^ poor) 

C. Is there sufficient variety in the materials to appeal to student 
interests? t 

1. Is there.' variety in method, mode, format, and instructional 
.strategies? ^: 

a. Are. there too many activities of the same kind which 

v 

might become boring to the students? 

b. Is the student allowed to tutor a peer or be tutored by 
\ a peer? < 

2. Are there alternative paths through the materials to 
V - accommodate individual differences? - 
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a. 'Do all students move through the materials in lock-step* 

or are there .opportunities for students to have unique 
progradb. that meet their needs? 

b. Where there are a variety of possible pathways and in- 

• • • 

dividual programs of study f are the teacher 's*djjtect ions 
* adequate for effective management of this variety? 
3. Is content. appealing to a range of interests? * ^ 

a. If I were the age of these students, would I find these 
^ materials interesting? If I were of similar background 

and experience as these children, would I probably enjoy 
working with these materials? 
A. Are materials functional, related to life experiences? 

* 

Quality of variety on the basis of Cl-4: 

(1 excellent; 2 good; 3 fair-; h_ poor) 
III. v Structure: 

A. Are there specif ic expressed instructional objectives or clearly ^ 
implied objectives on which the instruction is based? 

1. To what degree does the instruction teach to the objectives? 
a. Do randomly selected objectives have matching instructional 
materials which both teach and require demonstration of 
■. the identical behavior described by the objective? 

Quality rating of objectives on the basis of Al: 

U excellent; 2 good; 31 fair; 4 poor) 

B. How well are the objectives structured and sequenoed to build 
towards the terminal goals 
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1* as indicated by a, concept analysis? (sampling) 

a. For each generalization which is a part of an expressed 
or implied objecttve\are the component principle and 
concepts taught? * * 

* b. For' each principle which is part of an expressed* or implied 

* « • 

objective are the component concepts taught? 

2. as indicated by a content analysis? (sampling) 

» "* • 

a. When content/ previously encountered is' the subject matter 

of l$ter instruction, are references made to the earlier 

instruction to help build cognitive bridges and instruc- 

r • 

tional structure? 

* 

3. as indicated by a skill analysis? (sampling) 

a. Do the behaviors required of the students fall within the 
same taxonomy levels or are all levels of behavior sampled, 
when this is appropriate? 
Quality rating of sequencing on the basis of BI, 2, 3: ' 

* 

O excellent; 2^ good; 2 fair; ^ poor) 

C. Is there a testing procedure adequate to determine mastery of the 
objectives? 

1. How well do the test items, observation guidelines or other 
taastery criteria match the implied or explicit objectives? 
a. Are there self-test items in end of chapter and/or end 
of unit, or other curriculum tests which demand the 
behavior expressed in the selected objectives so the 
students are made aware of what mastery tes£s will re- 
qifire for progression? 
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,/ 2. Are all. objectives, stated or implied, measured or checked 

• • by observation and are criteria provided? 

Affective? * 
Cognitive? 
Psychomotor? 

a. For expressed affsctive objectives, is there any guidance 

* to judge whether they have been attained? 
example of criterion behavior supplied in 

the teacher f s manual or in other guidelines? 

b. When a concept is [taught, is it tested by requiring the 



in determining ho 
Is more than one 



student to distinguish between examples and non examples 
and to generate a new (e.g., untaught) example? 

c. When a principle lb taught, is it tested by requiring 

t recall of component concepts, by requiring stating the 

* principle and/or by asking the student to apply it, or 

describe cases whefce it would or would not be applicable? 

d. In generalizing, do students generate their own examples 

• « 

of the generalization? 
• e. In problem solving, do students select the appropriate 

principle and solve the problem? 

Quality rating of testing on the basis of CI,. 2: 

O excellent; _2 good; .3 f * ir ; A P oor ) 

D. Does the instructor's manual provide guidance for diagnosis and 
remedial treatment? 
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* * * * ^ 

1. How-adequate are the props which the instructor's manual 

' . A. - 4 • * 

^provides to guide ^the teacher ;in diagnosis of student n'eeds 

and for placement and progression? * 

a. Is'tjiere a scope and s^quefftffe chart to provide 'an overall 
picture df the structure oi^j^e instruction? 

2. How adequate is the guidance supplied b£ the teacher f s manual 
for alternate, remedial or supplemental instruction for 
students? 

a. How readily c^q remedial or supplementary materials be 

r 

plugged into t^bis structure? Does some simple and feasible 

coding system appear to be possible for facilitating use of 

s 

all available materials which can be fitted into the curric 
ulum structure? , ' 

b. tiow'well does this course, 'as it is structured, fit into 

> ■ 

the total school curriculum in this subject, especially 
the immediately preceding and succeeding courses? 

3. To what degree do the range of the objectives alone or the 
objectives combined with the remedial or supplemental in- 
struction match the range of the student population? 

QuaAty rating for guidance for diagnosis and treatment on. the 

basis of Dl,. 2, 3: 

(J. excellent; 2^ good; _3 fair; 4^ poor) 
^^trbctional Events (substance) : 

A. Does the teacher's manual (in-service or parent materials) 
furnish sufficient teaching assistance? 
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1. Information on methods? # 1 

(a. Do the Instructions to'*the teacher specify whether or, 
when th$ ipaterials teach indvctiVely or deductively? Do 
* they indicate if a discovery, guided discovery or indi- 

hi < vidual inquiry method is used? Are they used in accord- 



§§l ance with appropriate pedagogical procedures? 

^jt'. Information on strategies ?» 

a. Are instructional strategies ever mentioned at all in 
' descriptive or teacher materials? If they are not, it 

must be ^assumed that the teacher's cooperation is not 

required for effectiveness unless there is evidence to 

i 

the contrary. t 

' i 

3. Background information, vocabulary (definitions of terms} 
and procedures? 

a. Jfhen the materials require an* introduction by the teacher 
or a synthesis, is (the required information supplied for 

him or <her or must tn^ teacher supply it? 

t 

b. In presenting arfo i£f orm^kSn to the teacher on methods 
or strategies, are allterms defined and all procedures 
described? 

Quality of teacher props on the basis of Al, 2, 3i \ 

(_1 excellent; 2 good; 3^ fair; 4^ poor) 

B. Is the quality of instruction in student materials consistently 
high?' 

1. Content quality? 
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a. Does the teacher who Will teach from' these material? feel 

that the conteat is What should be taught in this subject 

» 

v. 

to these children^ What do the experts say the issues 
* are? /Taking these issues' into considetation is this the 
content you wpuld choose?* 
2. Concept quality? t . 



a. Are these th^ concepts scholars in the field recommend 
should be taught to children at this stage of their 
developmeftt? ^ 
•3. Skill quality? 

a. In-order to teach the children learning- to- leam skills, 
are- all taxonpmic levels sampled in these materials? 

Quality o£ teacher props on 'the basis of Bl, 2, 3: _^ 

(J. excellent; _2 good J3 fair; 4_ poor) 

C* Is the management system efficient enough to support the quality 
of instruction? 

1. Can students work steadily without delay or threat to the 
effectiveness of instructional events'? 

2. Can teachers manage instruction without frequent breakdowns k 
in the system? , 

Quality of management system on the basis of Cl f 2: 

(1 , excellent ; 2 good; 3 fair; 4 poor) 

Instructional Events (usage) % 

4 

D. -Are the instructional strategies and methods appropriate for 
this student population and -are they used effectively? 

• • •• \ . 
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1. Appropriateness of 1 strategy selection and usage? 

a. If the materials claim to use' certain instructional strat 

egies, do they also tell bow they are^used so you can 

•judge the appropriateness of selection and usage? 

• b. Following are some instructional- strategies! that you 

might waut to check for and to asfc Jyourself : Are they 

appropriate here and are thoy used correctly? 

small" steps 

cues* and prompts „ 

questions distributed through instructional 

faaterials (rather than only at the end) 
" advarice organizers 
backward chaining * 

concept-learning strategies based on range 

of instances 
subject area specific strategies such as 

modeling in blending 
practice 
reinforcement 
feedback 

2. Appropriateness of methods selection and usage? 

Quality of instructional strategies and metfiods based on Dl, 2: 

(J. excellent; 2 good; 3 fair; 4 poor) 
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Steps In Performing an Intrinsic Analysis 



Preparation and Previewing: 

A. Assemble and read carefully each ^ of the following which is 1 • , 
available to you: - • 

f . Advertising materials an£ any available developer's 
descriptions, rationale or scholarly papers on the ' 
program or process*. s 

2. The Introduction to the Teacher's Manual, Resource Books 
or Teacher's Edition (Except when articulation appears to 
be a problem, one level is enough to examine. However, 
each member of an LAX may- choose a different level to pro- 
vide a broader perspective.) 

• 3. Any already completed analyses (e.g., EPIE, CMAS, etc.) 

■ y ■ 

B. Answer the following questions, for which these above sources 

may provide information. (The claims in these assembled materials 
can be checked for accuracy in the analysis of the materials them- 
selves, later in the analysis -process) . Use your j>rof essional 
judgment to decide on the appropriate response. 

1. Are the content, concept and skill emphases the appro- 
priate ones for this school (teacher, student population)? 

2. Does the instructional method used in these materials 
match the philosophical and theoretical orientation of 
this teaching staff? 

3. Are the available curriculum components sufficient for your 
staff and can those that are. necessary be fit into the budget,? 
(e.g., clear chart of scope and sequence, teacher resource 
books., tests, supplementary materials.) 

4. Are there any constraints or criteria, identified by the 
LAT, which these materials fail to meet? 

If responses to any of these are negative (in t spite of PSIP 
prescreening) you may want to eliminate this outcome from 
consideration for adoption. 

> 

C. Select the appropriate intrinsic analysis instrument (i.e., the 
student, inservice, or parent instrument; or the management 
systems , practices or processes instrument) afid read it over be- 
fore beginning to use it to guide your work. 
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I. Opportu nity (SIP $orm) ' ' 

A. 1. Assemble and examine, as needed tp respond to instrument 

questions,, any of the following that are available; 

scope and sequence charts 
lists of course objectives 

sampling of lessons, preferably scattered throughout 

the materials. « 
the tests which follow closest to these lessons (which 
- may.be lesson tests, or curriculum embedded tests, or 

• unit tests) , 

" • . ' 

2. Answer the questions in the analysis instrument under opportunity 
(substance). \ 

3. Rate the substantive quality of the materials for opportunity, 
based on your responses to these questions. 

(If each question rates a 1, the quality rating should be 1, 
of course. If any one question rates a 4, "poor" ?\uou may 
consider giving the whole dimension a 4 rating. Iflthere 
1 « is no "poor" rating, you may prefer to average the scores. 

It is impossible to quantify' evaluation of these curriculum 

•elements and the ratings must be used as they are intended, 
only as a means of helping the analyst to retain and record 
his or her overall imprest* inn of each of several critical 
dimensions of the curriculum) . 

* .1 

4. If you are comparing curricula, enter your ratings for each 
question "on the products selection chart. 

B. l. Using the same materials assembled for A, with the addition -of 

student and class record forms, examine as necessary and answer 
the questions in the analysis instrument under opportunity (usage}. 

2., Rate the teaching in relation to the opportunity .construct by* the 
intensity of treatment of the lessons, clarity of objectives, 
criterion referencing of the tests to the objectives, and facilit- 
ation of on-task behavior by the management system. 

* 3. Rate the lessons on the degree ( to which they are adaptive enough 

to provide an opportunity to learn for all students,' regardless 
of their individual learning characteristics. 

4. Rate the usage quality of the materials for opportunity, based 
on your responses to these questions. t 

5. If you are comparing curricula, enter your ratings for each question 
on' opportunity, usage/ on the products selection chart. 
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II . Mot ivatofs 



< 



A. I.* Lay out all the instructional materials available to you for re- 
view. These will be used for spot checking and overall skimming. 

» For more intensive study, set aside a sampling of student materials 
(texts, workbooks, record fon^g etc •) and the teacher's manual. 

2* Uaing^Tie student's instructional materials and record forms and 
£<ve directions to the teacher on the conduct of class activities,, 
determine the degree of self-direction, selection and evaluation 
permitted and/or encouraged by the curriculum. 

- i - 

3. Respond to each question in this category and write a quality # 
rating for it. 

B. l. Examine directions to the teacher in the teacher's manual to 

determine what is suggested for reinf or cement and feedback to 
students. Identify, also, the amount of reinforcement and feed- 
back built int^p the student materials. 

* * 
«» 2. Respond to each question and rate the materials on quality of 

reinforcement and feedback. 

™* . * 

C. l. The total range of materials should be skimmed to observe the 

degree of variety they provide. 

2. The questions on motivation through interest, functional use and 
variety should then be answered and a rating on this dimension of 
motivation should be made. 

3. If curricula are being compared, a rating for each question under 
motivators should be entered on the products selection chart. 

III. Structure- 

A.l. Assemble the following: 

a sampling of lessons and tests (preferably different ones 
from those already used since the more portions of the curric- 
ulum you examine, the better your chances of uncovering any 
Inadequacies if such exist.) 

a scope and sequence chart # or a list of all the objectives 
for the course, 

the teacher's manual. 

2. examine and rate the match of instruction to'object ives - 
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B.l. Do a concept analysis, using the scope and sequence chart 
and selected lessons. - ~~ 

2. Do a content analysis using the scope and lequence chart 
or list of objectives-^ 

*3. Using the scope and sequence chart again, or list of objectives, 
and selected lessons, do a skill analysis. 

4. Rate "the sequencing on the basis of your analyses of content, 
concepts and skills. < | 

.C.l. Examine a sampling of related objectives, lessons and tests 

to determine the adequacy of their match. • 

2. Check a sampling of objectives (choosing some from each ■ 
domain - cognitive, affective, and psychomotor) to determine 
whether tests or teacher observation directions are provided 
for judging their attainment. ^ # 

4 

» 

3. Rate the testing procedures. 

D.l. Examine the instructor's manual, looking for the guidance provided 
for diagnosis of students' present abilities for placement. 
? 

2. Look for the clarity of the instructions to the teacher on 
when and*how to determine each succeeding assignment and what 
to do if the student fails' to master an objective. _ 

*3. Determine whether the suggestions for and provision of remedial 
and/or supplemental instruction meet the needs of all students 
in your school so each is provided a structured instructional 
plan building toward, the terminal goals of, the program. 

4. Rate diagnoses and remediation on the basis of -your responses 
to these questions. 

5. If you are comparing curricula, enter ratings for each question 
under structure on the product selection chart . 

* * 

IV. Instructional events 

A. 1. Assemble and examine, as needed, the following: 
teacher's, manual 
a sampling pf student lessons, 
management system record forms. 
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Determine the adequacy fit the assistance provided fot 

the teacher in. providing information on methods > strategies J 

procedures, and additional background information. \ 

Evaluate the quality of the content, concepts ^nd skills 
taught by these materials. \ 

Determine the efficiency of the management system in ' \ 
facilitating effective instructional events by responding 
to questions C.l, 2. 

♦ 

Enter a quality rating for instructional events (substance) 

Examine the teacher materials and students lessons to determine 
whether the strategies and methods are both' appropriate for 
these students and appropriately used and respond to each 
question under this category in the instrument. 

0 

Enter a quality rating for instructional events (usage). 

If you are comparing curricula fill in ratings for the instruc- 
tional events questions in the product selection chart. 
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Steps In Performing an Intrinsic Analysis 



Management Systems; Practices or Processes (tofe form V 

• , . • » > • 

Preparation and' Previewing is "a first step, as in the use of the SIP 
Form, The two 'items, Bl and 2 should read, for thJLs MPP form, ajs 
follow^: ' . X ' . " 

Bl. Is the management system, practice,.or process appropriate 
for this school, thls.e teachers and students? 

2. Does the instructional practice or process match the 
philosophical and theoretical orientation of this 
teaching staff? * ■ * 



I. Opportunity 

■A.l. 'Assemble and examine, as needed to respond to the questions 
in this instrument, any of the following that are available: 



student and class record forms 

teacher manuals aad/qr other directions to the 

teacher on the system; practice or process 
any in-service training descriptions or materials 
rationale or other description and theoretical , 

background for the system, practice or process 
any objectives, of the system, practice or process 

that explicitly indicate, its goa^s 
directions to students. 



2. Answer the questions in the analysis instrument under 
- opportunity. 



3. 



Rate the opportunity which this system, practice or process 
provides for learning in the ft>rm of more on ta^k time £6r 
students, and direct instructional time art d active guidance 
of learning, by the teacher. 



4. If you are comparing systems practices or processes, enter 

your ratings for each question on the selection chart , J process . 

S 

II. Motivators % 

r — 

A.l. Using the same materials already assembled, examine them and 
answer each question under the construct, motivators, related 
to the advantages provided student and teacher, 

2, Rate the motivators that are based on saving of teacher time^and 
effort, help for the teacher ift teaching more effectively and help 
for the student in active learning time of interest to him or her. 
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B.l. Answer the questions under rtotivators related to self- 
management ^provisions of the system, practice or process. 

2. Enter a quality rating for student sel f -selection, self- 
evaluation f independent planning and freedom to interact 
cognitively with peers. 

3. If you are comparing systems, practices or process, enter 
your ratings for each question on the selection chart, 
process. 0 

Structure ., - ' * 

A.l' Among the artifacts you vere asked (a>ove) to assemtfll£, if 

available, were objectives of the management systein(^ practice 
'or process. If there are no explicit objectives, they must 
be inferred from the descriptive materials and rationale. It. 
would be helpful, if you are dealing with objectives the de- 
veloper has implied, rather than explicitly stated, if you 
\ would list them for your use in responding to the questions 

, under the construct, structure. 

2. Answer each of the questions under structure to "identify the 
degree of match of the objectives to the problem(s) the school 
wants to work on and to the capabilities of students and teach 

* ers and constraints of the environment. Also to be identified 
is the degree directions and/or instructions' are provided for 
the user .of the system practice or process. 

3. Enter a quality rating for your analysis of the degree ofi 
structure* made available by this system, practice or process 
through its provision of appropriate objectives anty how-to- 
do-it information for structuring the system. 

4„ Enter your ratings on the process selection chart, if appro- 
priate. # 

t 

Instructional Strategies 

A.l. Using, again, the artifacts required for sections I, II and 

III, Examine them to determine whether or not they assist the 
teacher in the planning and execution of appropriate instruc- 
tional strategies^ 

2. Respond to the question on the degree to which the system 
relieves the teacher of clerical and management duties (if 

• it does so at all). 
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Respond the questions on the , system 'q^usf; ^Ineffective in- 
structional strategies and the encoirrag@e^tIl ^Instruction or 
examples it provides the teacher for generating his or her 
own effective strategies. 



Enter a quality rating for appropriateness of 4 instructional 
strategy assistance provided by 'the 'lays tern, practice or 



process. 



For comparison during selection, ent£r ratings^! the process 
selection form. * ■ ' . 
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Selection Chart (Products) 


STUDENT MATERIALS 

- — 1 - s r ■ — — — ■ — 


Outcome 
A 


Outcome 


Outcome 


(Hit coinc 
I) 


"ELEMENT ANALYZED: * 


1 

i 






§ • - 
I. Opportunity, (substance) : 




« 






|^rtitent/Conceft>ts/SKills 

appropriate skill level sampling 
content relevance to student 


i *f-r- — 




• * 


r . 


appropriate concept instance range 
Opportunity (usage): ' 










intensity of treatment * 










adapt iveness to student needs 

* Totals 






- 




II. Motivators: 






• * 




self-directlon/selection/evaluatlon 








* 


reward system 4 










vari-ety 


! 








Totals 




















HI. Structure: 

• 


4 








quality of objectives 










quality of sequencing 






- 




quality of testing 










guidance for diagnosis and treatment 


* 








Totals 




















IV- , 

Instructional Events (substance): 


• 


* 







m t 

in manual (quality of teacher props) 


A 


> 






in student materials (quality of instruction) 










in management system (quality of procedures) 






■ : 




Instructional Events (usage): 

appropriateness of strategies and their 
usage for this population. 




• 


f 




t 


n .„ consistency and appropriateness of methods. 










1 * ' ' — ' — i 


■ 








- * 
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STUDENT MATERIALS 



Selection Chart (Processes) 

System 

A 



System 



System 
C 



System 

n 



I 

ELEMENT ANALYZED : 

I. Opportunity : 

Time for learning 



II. 



increase in on task time 



increase in active teaching or 
guidance of student learning 



Totals 



Motivators: 
Advantages to student and teacher 

. saving of teacher time and effort 



assi&tance for more effective 
t dftht ng i 



more student time for learning 
of interest to him or her 



Independent learning 

student selection of activities 



student correction 



student planning of time 



IV. 



sel ection of work - matps 



Totals 



III. St ructure : 



Process Objectives 

match to school needs 



ad e quac y of instructions Dn process 



V 



match to student and teacher capa- 
bilities and environmental constraints 



Totals 



Instructional Events 

Planning and selection of strategics 

je Uef . Ixqelc lfill ca JL_ mgn agemen t_d_u£ ies 

incorporated *.fle.ctivg..in.str.uctlpoal_8.txat.egigs 

strategy examples, strategy teaching etc. I 

ais yt27 
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Annotated Bibliography 

The following bibliography lists the major research reports and -the 

reviews of research which support the constructs and dimensions used in 

this manual. The use of these constructs for diagnosis, by analyzir^ the 

curriculum materials or instructional processes currently in use or for 

selection by analyzing potential new curricula or instructional processes, 

# 

is different^ from their intended use for analysis of classroom processes. 

i 

However, in keeping with the new. purpose, the constructs have been re- 

defined in terms of different dimensions or the same dimensions from a 

I different perspective because the subjects of the analysis are the, artl- 

facts erf instruction, the tangible materials used l>y teachers or students 

for teaching, learning or managing instruction. 

Before listing sources which support the constructs, it seems appro- 

ppiate to point out some superior general sources of research information 
« 

fqr teachers. Volumes produced annually which provicJB excellent syntheses 

of (he research are National Society for the Study of Education Yearbooks, 

American Educational Research Association, Reviews of Research in Education 

and the less frequently issued Handbooks of Research on Teaching. 

Specifically, particularly use editions are the following: 

Gaga, N. L., ed. Handbook of Research on Teaching , Chicago: Rand 
. McNally and Co., 1963. 

Gage, N. L., ed. The Psychology of Teaching Methods , 75:1. National 

Society. for the Study of Education, Chicago: University of Chicago 
Press, 1976. 

Hilgard, E. R. , ed. Theories of Learning and Instruction , 63:1. National 
Society for the Study of Education, Chicago: University of Chicago 
Press, 1964. 

* 
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Shulmari, L. S., ed. Review of Research in Education ; 5. American 
Educational Research Association, Itasca, Illinois: F. E. 
Peacock, 1977. 

Travers, R. M. , ed. Second Handbook of Research on Teaching . Chicago: 
Rand McNally and Co., 1973. 

Opportunity 1 

The following studies support the construct opportunity to learn, 

particularly as related to achievement in basic skills* Time spent on 

academic content was found to be associatfl/d with growth in the area covered 

in all of the research studies and sigprifary reports. Carroll, Blood and 

Coo ley and Lohnes 'have developed and defined the construct. 

Armento, B. "Correlates of Teacher Effectiveness in Social Studies, 11 
Ph.D. dissertation, Indiana University, 1975. 

Bloom, B. S. "Time and Learning, 11 American- Psychologist , 1974, 29, 

• 682-688. - 

Bloom. 3. S. Human Characteristics and School Learning . New York: 
McGraw Hill, 1976. 

0 

Bond, G L. & Dykstra, R. Final Report . (USOE, HEW ProjAt #001-OE-5-10-264> • 
Minneapolis: University of Minnesota, Coordinating Center for First 
Grade Reading Instruction Programs, 1967. 

Carroll, J. B. "A Moael of School Learning." Teacher r s College Record , 
1963, 64, 723-733. 

Chang, S. S. & Raths, J. P. "The Schools 1 Contribution to the Cumulating 
Deficit." Journal of Educational Research , 1971, €>4, 272-276. 

Cooley, W. W. & Leinhardt , G, The Application of a Model for Investigating 
Classroom Processes . Pittsburgh: Learning Research and Development 
Center, 1975. 

w 

Cooley, W. W. & Lohnes, P. R. Evaluation Research in Education . New York: . 
Irvington Publishers, 1976. 

9 

Rosenshine, B. "Classroom Instruction." sin N. L. Gag£,- ed. The Psych- 
ology of Teaching Methods 75:1. National Society for the Study of 
, Education. Chicago: University of Chicago Press, 1976, 355-371. 
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Rosenshine, B. & Berliner, D. "Academic Engaged Time," Richard Anderson 
etal.'eds. Schooling and the Acquisition of Knowledge . Hillsdale, 
NJ: Erlbaum Publishers, 1977. 

Stalling*', J. A. & Kaskowitz, D. H. Follow Through Classroom Observation 
Evaluation, 1972-73 . Menlo Park, CA: Stanford Research Institute, 
1974. 

Walker, D. F. & Schaf farziek, J. "Comparing Curricula." Review of 
Educational Research , 1974, 44:1, 83-111. 

Wiley, D. E. & Harneschfeger , A. "Explosion of a Myth: Quantity of 

Schooling' and Exposure to Instruction, Major Educational Vehicles," 
Educational Researcher , 1974, JJ» 7-12. 

Opportunity (substance and usage) - 

The concepts- of appropriate match of the instruction to needs of 
% the student both in the substance of the instruction and its use are im- 
portant dimensions of opportunity, as we have noted. Time spent on in- 
appropriate instruction, or instruction that is not employed as it should 
**be f clearly cannot offer the student the opportunity to leafn. 

Among tfc sources which deal with this match of instruction to 
student needs are the following: 

Bruner , J. , Goodnow, J. J. & Austin, C. A, A Study of Thinking. New 
York: /ohn Wiley, 1956. (Concept learning) 

CoKen, R. ff The Relation Between Socio-Conceptual Styles and Orientation 
to School Requirements," Sociology of Education , 1968, kZ % 201-220. 
' (Relational/Analytical learning styles) 

Dunn, R. & Dunn K. Teaching Students Through Their Individual Learning 
Styles: A Practical Approach . Reston, VA: Reston Publishing Co., 
1978. (Learning styles) 

Flavell, J. H. The Developmental Psychology of Jean Piaget . New York: 
Van Nostrand, 1963. (Developmental Stages) ■ 

Gagne' R. M. , ed. Learning and Individual Differences . Columbus: 

Charles E. Merrill, 1967. (Individual differences of several kinds) 
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Hunt, D; E. Matching Models In Education . Ontario: Institute' for Studies 
in -Education:, 1971. (Cognitive-^style) 

\ 

Kagan, J. "Personality and the Learning Process." Creativity and Learn- 
ing . Boston: Houghton Mifflin. Co., 1967, 153-163. (Reflection- 
impulsivlty) 

Rosner, J. "Language Arts and Arithmetic Achievement arid Specifically 
Related Perceptual Skills," American Educational Research Journal 
1973, iO, 59-68. 

Direct Instruction 

Sources on direct instruction are separated from the other references 
related to opportunity because the concept of interpreting direct instruc- 
tion in terms of materials is unique. The idea of direct instruction has 
developed simultaneously from several sources as Rosenshine has noted. 
Rosenshine. defines it as "the time which a student spends in academically 
relevant material vhi^i is of a moderate level of difficulty." He calls 
attention to the term within the trademark DISTAR. Berliner has written 
of "academic engaged time." The two components of this are content covered 
or opportunity to learn and student attention or engagement. 

While Rosenshiire'has suggested that research is needed to identify 
"engaging" materials, Smith, Rothkopf and Koether have reported that the 
amount of unrelated material in reading passages "predicted goal achieve- 
ment better than any other formal characteristics of the nominal stimulus 
measured." This is the closest research available to the idea of direct 
instruction in materials t and seems to imply that concentrated material^ 
with little irrelevant (unrelated) material are more readily learned. 
Translated int.o direct instruction or academic engaged time, such a char- 
act«^istic may be one dimension of "engaging" materials or direct instruc-- 
tion in materials. I have termed this "intensity of treatment." 'These 
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^tentioned sources are listed here: 

Rosenshine, B. "Primary Grades Instruction and Student Achievement Gain/ 1 
Paper presented at the annual meeting of the American Educational 
Research Association, New York City, April, 1977. 

Rosenshine, B. & Berliner D. "Academic Engaged Time- M Ptepublication 
paper to appear in R. Anderson, et al. eda* Schooling and 'the 
Acquisition of Knowledge , Hillsdale, NJ f Lawrence Erlbaum Asso- 
ciates, 1977. 

i 

Smith, M. f Rothkopf, E. Z. t Koether, M. E. "The 1 Evaluation of Instruc- 
tional Text Properties." Paper presented at the annual meeting of 
the American Educational Research Association^ Minneapolis, March, 
1970. 

Motivators • # 

Writers on teaching methodology comment on interests, but as we have 
indicated, it is difficult and dangerous to generalize about what is essen- 
tially a characteristic that teachers must observe directly in each indi- 
vidual case.* Wtfat children of different ages usually enjoy in reading 
^ material is discussed in the following source: * 

Dechant, E. V. & Smith, H. P. Psychology in Teaching Reading . Englewood 
Cliffs, NJ: Prentice-Hall, 1977. f 

The motivating affect of variety and change in activities, materials, 

format and responses "demainded is discussed in the following sources: 

Berlyne, D. W. Conflict, Arousal and Curiosity * New York: McGraw Hill, 
1960. 

Glaser, R. "Learning. " C. W. Harris, ed. Encyclopedia of Educational 
Research* , 4. 'New York: MacMillan and Co., 1969 , 706-733 . 

Peer tutoring as a motivator is discussed in the following sources: 

Cooley, W. W. & Leinhardt, G. Evaluating Individualized Education jn thfe 
Elementary School . Pittsburgh ; Learning Research and Development 
Center, 1974. , 
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Lindvall, C. M. "The Use of Peer Tutoring in IFI Classrooms ." D. T. Gow, 

ed., Design and Development of Curricula Materials, Vol. 2 . 

' Pittsburgh: University Center fqr International Studies Publica- 
tions, 1976, 264-266. ' • 

The motivating effect of self direction is reported in:<< 

Wang, M. The Self Schedule System for Instructional Learning . Pittsburgh: 
Learning Research and Development Center, 1976. 

Reports on the effects of feedback and reinforcement on learning 

are well covered in the following works: 

Carroll, J. B. & Chall, J. S. Towards a Literate Society . The Report of 
the Committee on Reading of the National Academy of Education. New 
York: McGraw Hill, 1975. 

Gage, N. L. & Berliner, D. C. Educational Psychology . Chicago: Rand ^ 
McNally and Co., 1975. - 

Gage, N. L. & Berliner, D. C. -"The Psychology of Teaching Methods." 

N. L. Gage, ed. , The Psychology of Teaching Methods 75:1 . National 
Society for^ the Study of Education. Chicago: University of 
Chicago Press, 1976, 1-20. 

Hamblin, R. L. , • Buckholdt , D. , Ferritor, M. H. & Blackwell, L. B. The 
Humanization Processes . New York; John Wiley and Sons, 1971. 

Lumsdalne, A. A. & Glaser, R., eds., Teaching Machines and Programmed 
Learning: A Source Book . Washington, DC: National Education 
Association, 1960. 

Stallings, J. A. & Kaskowitz, D. H,. Follow- Through Classroom Observation 
Evaluation ; 1972-73. .Mealo Park, CA: Stanford Research Institute, 
1974. . - ' 

Structure 

■ - 
* * 

The following works discuss the concept of structure of a discipline 

and describe procedures for writing objectives and structuring instruction: 

Ausubel, D. P. "Some Psychological Aspects, of the Structure of Knowledge/" 
Stanley Elam, ed., Education and the Structure of Knowledge - Chicago 
• Rand McNally, 1964, 221-249. 
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Bloom, B. S., ed. Taxonomy of Educational Objectives, Handbook 1: 
Cognitive Domain . New York: Longmans, Green and Co., 1956. 

Bruner, J. The Process of Education . Cambridge: Harvard University 
Press, 1960. * . • 

Gagne, R. The Conditions of Learning . New York: Holt, Rinehart and 
Winston, 1965. 

Gow, D. T. Design and Development of Curricula Materials, Vols. 1 and 2 . 
Pittsburgh: University Center for International Studies Publica- 
tions, 1976. 

-Krathwohl, D. , Bloom, B. S. & Masia, B. Taxonomy of Educational Objectives 
Handbook 2: Affective Domain . New York: < David McKay Co.,- 1964. 

ger, R. F. Preparing Instructional Objectives . Belmont CA: Fearon 
Publishers, 1962. * ' - 

Schwab, J. J. "The Concept of the Structure of a Discipline." Gow.D. T., 
ed., Design and Development of Curricular Materials, Vol. 2 . 
Pittsburgh: University Center for International Studies Publica- 
tions, 1976, 16-23. 

» « 

Instructional Events 

The following studies provide some information on the effects of 

different instructional activities on different kinds of students: 

Brophy, J. E. & Evertson, C. M. Process-Product Moment Correlations in 
the Texas Teacher Effectiveness Study: Final Report . Austin, TX: 
University of Texas, 1974. 

Rosenshine, B. "Classroorf Instruction." N\ L. Gage, ed. , ' The Psycholog y 
of Teaching Methods , 75:1. National Society for the Study of 
Education. Chicago: University of Chicago Press, 1976, 335-371. 4 

Stallings, J. & Kaskowitz, D. H. Follow- Through Classroom Observation 

Evaluation , 1972-73. Menlo Park, CA: Stanford Research*Institute> 
1974. 

The following sources provide information on the use^of behaviorist 
instructional strategies: cues, prompts, feedback, reinforcement, success- 
ive approximations, etc.: 
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• Randura, A. Principles of Behavior Modification . New York: Holt, 
Rinehart and Winston, 1969. 

Homme, L. & Tosti, D. Behavior Technology . San Rafael, CA: Individual 
4 Learning Systems, 1971. (Self instructional) 

Taber, J. I., Glaser, R. & Schaefer, H. H. Learning and Programmed In- 
struction . Reading, MA: Addison-Wesley, 1965. 

Thoresen, Carl £. , ed. Behavior Modification in Education. 72. National 
Society for the Study of Education. Chicago: University of 
Chicago Press, 1973. 

The following are excellent sources for cognitive instructional 
strategies: 

Ausubel, D. P. Educational Psychology: A Cognitive View;. New York: 
Holt, Rinehart & Winston, 1968. , 

Ausubel, D. P. "The Use of Advance Organizers in the Learning and 

• Retention of Meaningful Verbal Materials." Journal of Educational 
Psychology , 51_, 1960, 267-272. 

**jt'! Jl Bruner, J. S., Goodnow, J. J. & Austin, G. A. A Study of Thinking . New 

York: John Wiley and Sons, 1962. 
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